-- Logs begin at Wed 2021-07-28 08:47:36 UTC, end at Wed 2021-07-28 09:45:00 UTC. -- Jul 28 09:16:34.038648 dv-cinder-802669-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 09:16:34.046085 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 09:16:34 2021] *** Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: nodename: dv-cinder-802669-1-iscsi Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: machine: x86_64 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: clock source: unix Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: pcre jit disabled Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: detected number of CPU cores: 4 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: current working directory: / Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: detected binary path: /usr/bin/uwsgi-core Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: your processes number limit is 47680 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: your memory page size is 4096 bytes Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: detected max file descriptor number: 2048 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: lock engine: pthread robust mutexes Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: thunder lock: enabled Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 09:16:34.050817 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 09:16:34.095177 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: Python main interpreter initialized at 0x561577b879c0 Jul 28 09:16:34.095177 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: python threads support enabled Jul 28 09:16:34.095177 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: your server socket listen backlog is limited to 100 connections Jul 28 09:16:34.095177 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: your mercy for graceful operations on workers is 90 seconds Jul 28 09:16:34.095559 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 09:16:34.095665 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: *** Operational MODE: preforking *** Jul 28 09:16:34.095879 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: *** uWSGI is running in multiple interpreter mode *** Jul 28 09:16:34.095879 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: spawned uWSGI master process (pid: 92340) Jul 28 09:16:34.096084 dv-cinder-802669-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 09:16:34.097223 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: spawned uWSGI worker 1 (pid: 92341, cores: 1) Jul 28 09:16:34.097223 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: spawned uWSGI worker 2 (pid: 92342, cores: 1) Jul 28 09:16:34.097223 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 09:16:35.737915 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:16:35.737915 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: from cryptography.utils import int_from_bytes Jul 28 09:16:35.738584 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:16:35.738584 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: from cryptography.utils import int_from_bytes Jul 28 09:16:35.752047 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:16:35.752047 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: from cryptography.utils import int_from_bytes Jul 28 09:16:35.752557 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:16:35.752557 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: from cryptography.utils import int_from_bytes Jul 28 09:16:38.404853 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:16:38.405370 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:16:38.405555 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:16:38.405912 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:16:38.406169 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:16:38.406558 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.406881 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.407198 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.407520 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.407873 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.408182 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.408501 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.408818 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.409144 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.409402 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.409717 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.410041 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802669-1-iscsi {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.410361 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.410665 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.410974 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.411291 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.411376 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:16:38.411766 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.411847 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:16:38.411923 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.412130 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:16:38.412224 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.412559 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:16:38.412692 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.412858 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:16:38.413131 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.413322 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.413471 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.413644 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.413735 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.413945 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.414062 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.414268 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.414383 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.414601 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.414698 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.414914 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.415010 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.415247 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.415341 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.415567 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.415679 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.415894 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.416050 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.416284 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802669-1-iscsi {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.416410 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.416600 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.416726 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.416909 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.417035 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802669-1-iscsi {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.417220 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.417602 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.417737 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.417860 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.417978 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.418098 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.418217 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.418377 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.418502 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.418721 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.418845 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.419661 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.419797 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.420011 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.420234 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.420356 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.420591 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.420818 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.420964 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.421175 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.421301 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.421534 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.421689 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.421816 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.421965 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422086 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422246 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422374 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422620 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422754 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422875 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.422994 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.423177 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.423316 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.423496 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.423681 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.423844 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424047 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424196 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424397 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424526 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424648 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424835 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802669-1-iscsi {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.424961 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.425209 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.425341 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.425532 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.425655 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.425837 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.425962 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.426140 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.426303 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.426437 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.426620 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.426757 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.426936 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.427067 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.427261 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.427387 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.427605 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.427841 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428044 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428168 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428294 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428445 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428566 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428700 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428828 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.428948 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.429114 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.429237 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.429445 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.429568 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.429746 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.429869 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430050 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430174 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430367 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430497 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430674 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430804 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.430978 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.431099 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.431230 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.431350 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.431526 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.431662 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.431888 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432021 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432200 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432333 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432503 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432633 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432758 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.432889 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433018 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433146 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433296 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433425 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433619 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433752 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.433930 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.434068 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.434258 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.434381 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.434550 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.435271 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.435666 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.435856 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436076 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436076 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436331 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436504 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436639 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436760 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.436879 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437000 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437166 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437299 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437469 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437601 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437771 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.437895 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438069 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438195 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438371 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438497 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438672 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438797 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.438974 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.439143 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.439288 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.439413 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.439624 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.439764 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.439930 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440057 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440230 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440355 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440532 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440664 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440833 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.440959 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.441148 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.441275 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.441451 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.441582 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.441751 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.441876 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442067 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442192 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442368 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442500 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442668 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442792 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.442981 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.443112 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.443281 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.443414 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.443613 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.443741 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.443911 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444044 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444204 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444336 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444505 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444629 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444817 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.444940 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.445115 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.445247 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.445413 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.445535 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.445708 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.445839 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446008 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446133 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446307 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446431 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446607 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446738 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.446905 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447042 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447202 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447326 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447495 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447654 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447824 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.447949 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.448133 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.448258 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.448444 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.448567 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.448745 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.448871 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.449047 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.449171 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.449348 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.449470 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.449653 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.449778 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.449959 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.450097 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.450367 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.450538 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.450685 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.450967 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.451070 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.451279 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.451403 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.451634 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.451765 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.451947 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.452071 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.452252 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.452383 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.452572 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.452698 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.452877 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.453000 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.453180 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.453303 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.453489 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.453614 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.453787 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.453910 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.454095 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.454226 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.454413 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.454539 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.454722 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.454856 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.455045 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.455171 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.455369 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.455492 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.455630 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.455763 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.455937 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.456074 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.456244 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.456374 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.456547 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.456671 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.456851 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.456985 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.457149 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.457280 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.457468 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.457593 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.457789 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.457923 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.458098 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.458222 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.458404 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.458529 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.458711 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.458843 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.459018 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.459140 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:16:38.459329 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.459464 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.459662 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.459803 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.459983 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.460116 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.460293 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.460418 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.460604 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.460742 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.460938 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461064 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461251 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461376 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461566 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461697 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461868 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.461991 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.462173 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.462298 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.462476 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.462614 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.462783 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.462908 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.463086 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.463224 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.463400 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.463524 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.463753 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.463878 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464060 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464187 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464383 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464507 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464686 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464809 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.464996 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.465129 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.465304 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.465429 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.465605 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.465736 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.466032 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.466170 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.466350 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.466615 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.466748 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467019 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467143 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467272 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467395 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467552 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467728 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.467900 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468036 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468206 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468338 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468509 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468641 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468823 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.468953 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.469134 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.469259 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.469442 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.469576 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.469752 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.469885 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.470070 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.470193 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.470376 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.470501 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.470685 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.470817 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471015 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471139 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471329 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471452 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471656 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471794 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.471972 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.472103 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.472280 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.472410 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.472587 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.472723 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.472886 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473002 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473193 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473323 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473493 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473631 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473801 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.473933 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.474105 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.474230 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.474412 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.474546 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.474714 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.474839 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475016 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475140 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475317 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475443 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475641 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475771 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.475946 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476071 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476257 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476382 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476560 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476684 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476862 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.476994 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.477164 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.477289 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.477464 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.477588 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.477786 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.477985 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.478117 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.478238 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.478387 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.478512 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.478703 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.478836 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479016 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479141 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479328 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479451 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479660 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479804 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.479967 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.480092 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.480271 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.480396 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.480581 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.480714 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.480902 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.481035 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.481205 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.481334 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.482102 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.482285 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.482602 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.482733 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.482918 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.483044 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.483243 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.483369 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.483615 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.483743 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.483912 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484036 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484224 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484351 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484530 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484661 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484841 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.484966 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.485145 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.485270 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.485450 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.485573 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.485751 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.485875 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486055 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486181 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486358 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486481 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486665 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486789 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.486973 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.487098 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.487280 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.487404 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.487636 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.487794 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.487920 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.488041 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.488300 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.488425 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.488603 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.488904 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.489029 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.489211 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.489449 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.489573 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.489825 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.490066 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.490193 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.490444 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.490645 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.490769 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.491032 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.491273 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.491399 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.491718 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.491906 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.492032 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.492262 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.492499 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.492625 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.492887 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.493090 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.493216 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.493484 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.493660 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.493785 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.494104 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.494235 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.494411 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.494727 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.494852 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.495035 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.495344 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.495467 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.495691 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.496006 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.496139 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.496312 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.496601 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.496727 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.496914 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.497711 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.497855 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.498166 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.498291 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.498505 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.498752 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.499074 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.499210 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.499388 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.499540 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.499726 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.499905 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.500032 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.500231 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.500357 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.500555 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.500687 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.500880 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.501196 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.501323 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.501507 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.501630 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.501829 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.501961 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.502148 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.502273 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.502466 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.502591 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.502783 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.502909 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.503113 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.503238 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.503440 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.503607 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.503781 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.503968 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.504094 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.504323 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.504448 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.504674 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.504808 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.504974 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.505098 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.505284 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.505415 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.505588 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.505721 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.505891 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.506083 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.506215 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.506452 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.506578 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.506775 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.506906 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507075 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507202 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507367 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507502 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507685 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507865 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.507989 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.508218 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.508345 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.508569 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.508695 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.508867 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.508997 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.509186 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.509312 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.509494 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.509655 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.509780 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.510002 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.510127 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.510363 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.510497 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.510700 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.510824 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.511005 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.511130 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.511344 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.511546 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.511729 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.511852 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.512027 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.512152 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.512334 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.512492 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.512662 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.513020 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.513150 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.513376 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.513580 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.513713 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.513946 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.514071 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.514272 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.514403 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.514582 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.514708 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.514889 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.515021 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.515212 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.515400 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.515534 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.515794 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.515958 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.516141 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.516265 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.516444 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.516570 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.516753 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.516876 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.517056 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.517180 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.517372 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.517497 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.517680 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.517984 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.518109 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.518285 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.518651 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.518784 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.518907 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519028 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519155 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519287 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519466 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519656 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519782 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.519977 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.520102 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.520357 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.520489 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.520668 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.520795 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.520970 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.521097 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.521278 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.521409 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.521586 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.521776 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.521908 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.522062 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.522185 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.522409 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.522535 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.522762 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.522886 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.523066 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.523188 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.523367 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.523500 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.523691 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.523829 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524000 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524124 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524320 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524468 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524639 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524813 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.524977 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.525159 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.525294 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.525750 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.525886 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526062 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526241 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526408 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526544 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526667 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526842 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.526966 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.527190 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.527325 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.527536 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.527684 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.527861 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.527986 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.528163 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.528804 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.529087 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.529256 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.529402 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.529707 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.529831 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.530012 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.530145 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.530313 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.530498 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.530656 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.530901 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.531038 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.531282 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.531408 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.531624 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.531765 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.531944 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.532072 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.532261 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.532395 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.532570 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.532748 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.532883 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.533096 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.533220 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.533442 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.533566 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.533762 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.533894 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534069 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534203 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534400 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534532 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534654 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534783 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.534950 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.535137 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.535269 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.535490 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.535761 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.535901 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536033 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536188 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536313 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536509 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536635 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536828 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.536962 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.537129 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.537254 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.537435 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.537560 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.537742 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.537941 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.538071 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.538193 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.538340 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.538529 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.538668 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.538890 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539015 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539231 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539355 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539541 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539700 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539871 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.539996 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.540178 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.540304 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.540481 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.540615 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.540790 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.540917 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.541096 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.541259 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.541384 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.541603 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.541729 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.541952 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.542085 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.542285 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.542408 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.542593 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.542719 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.542894 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.543012 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.543201 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.543337 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.543502 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.543654 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.544006 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.544621 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.544811 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.545128 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.545254 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.545432 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.545557 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.545742 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.545859 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.546051 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.546176 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.546367 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.546550 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.546682 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.546896 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.547031 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.547249 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.547381 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.547631 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.547761 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.547963 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.548098 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.548289 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.548414 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.548596 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.548721 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.548900 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549026 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549208 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549333 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549531 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549656 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549836 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.549962 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.550139 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.550265 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.550444 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.550617 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.550752 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.550968 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.551094 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.551313 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.551438 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.551681 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.551825 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.552027 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.552152 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.552382 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.552505 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.552771 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.552903 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.553096 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.553220 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.553408 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.553533 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.553732 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.553859 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.554055 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.554179 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.554376 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.554528 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.554662 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.554881 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.555012 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.555235 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.555362 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.555618 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.555760 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.555928 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556060 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556238 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556371 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556551 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556685 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556854 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.556985 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.557176 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.557372 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.557505 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.557628 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.557795 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.557990 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.558124 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.558366 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.558504 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.558746 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.558871 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.559110 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.559235 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.559427 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.559610 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.559828 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.560049 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.560205 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.560419 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.560549 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.560717 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.560866 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.561021 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.561223 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.561348 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.561581 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.561709 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.561921 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562053 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562230 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562356 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562540 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562675 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562846 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.562971 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.563148 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.563327 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.563460 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.563706 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.563835 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.564058 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.564195 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.564377 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.564511 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.564691 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.564867 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565017 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565143 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565339 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565476 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565642 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565847 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.565981 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.566194 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.566332 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.566544 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.566675 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.566847 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.566994 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.567184 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.567318 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.567477 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.567625 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.567805 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.568065 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.568192 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.568435 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.568562 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.568756 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.568879 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.569064 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.569190 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.569386 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.569511 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.569703 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.569829 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570017 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570156 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570333 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570459 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570653 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570803 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.570953 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.571252 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.571378 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.571558 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.571717 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.571883 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572008 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572187 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572314 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572488 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572613 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572792 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.572923 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.573088 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.573213 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.573387 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.573518 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.573686 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.573820 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574004 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574127 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574302 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574425 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574622 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574755 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.574927 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.575050 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.575252 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.575525 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.575687 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.575877 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.576088 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.576213 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.576410 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.576536 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.576726 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.576860 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.577119 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.577250 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.577439 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.577565 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.577753 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.577886 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.578059 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.578183 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.578380 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.578507 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.578695 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.578828 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579001 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579150 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579311 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579439 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579643 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579781 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.579980 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.580104 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.580254 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.580387 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.580564 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.580691 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.580871 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581004 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581184 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581310 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581496 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581623 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581810 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.581937 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.582124 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.582329 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.582456 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.582655 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.582860 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.582994 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.583188 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.583313 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.583503 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.583653 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.583866 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.583991 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.584178 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.584304 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.584487 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.584624 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.584791 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.584916 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.585101 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.585254 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.585405 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.585537 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.585714 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.585840 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586036 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586162 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586339 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586471 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586653 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586791 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.586965 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.587090 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.587275 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.587400 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.587626 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.587755 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.587912 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588048 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588238 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588365 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588541 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588667 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588856 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.588982 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.589168 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.589293 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.589481 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.589605 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.589798 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.589931 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.590102 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.590226 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.590409 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.590533 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.590720 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.591358 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.591547 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.591783 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.591908 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.592205 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.592338 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.592476 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.592599 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.592774 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.592899 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.593093 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.593218 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.593420 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.593545 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.593734 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.593858 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.594044 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.594180 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.594370 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.594494 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.594717 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.594842 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.595050 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.595356 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.595484 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.595701 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.595826 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596032 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596168 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596339 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596473 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596643 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596768 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.596956 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.597123 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.597257 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.597479 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.597604 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.597844 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.597976 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.598150 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.598275 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.598453 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.598585 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.598757 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.598882 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.599061 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.599188 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.599389 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.599515 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.599722 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.599871 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.600049 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.600219 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.600344 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.600560 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.600686 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.600914 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.601050 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.601230 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.601354 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.601576 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.601845 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.601979 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.602206 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.602329 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.602524 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.602657 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.602856 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.602990 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.603189 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.603314 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.603503 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.603706 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.603857 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.603996 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.604177 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.604302 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.604494 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.604619 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.604812 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.604946 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.605130 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.605295 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.605445 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.605643 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.605761 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.605985 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.606117 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.606326 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.606504 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.606820 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.606961 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.607171 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.607336 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.607513 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.607658 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.607887 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.608189 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.608317 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.608529 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.608662 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.608854 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.608980 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.609177 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.609311 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.609498 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.609623 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.609822 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.609955 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.610141 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.610267 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.610458 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.610585 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.610774 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.610975 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.611107 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.611236 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.611390 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.611515 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.611745 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.611881 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.612075 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.612223 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.612409 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.612565 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.612754 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.612911 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.613081 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.613253 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.613400 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.613599 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.613732 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.613938 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.614064 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.614297 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.614423 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.614639 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.614774 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.614977 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.615102 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.615301 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.615426 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.615648 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.615790 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.615974 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.616102 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.616294 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.616419 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.616610 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.616736 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.616925 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.617059 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.617247 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.617406 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.617567 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.617880 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.618027 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.618194 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.618409 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.618536 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.618772 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.618905 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.619151 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.619275 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.619642 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.619758 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.619892 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.620015 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.620143 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.620277 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.620399 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.620551 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.620919 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.621045 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.621239 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.621365 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.621574 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.621707 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.621900 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.622536 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.622855 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.623039 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.623299 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.623434 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.623709 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.623839 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.624056 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.624283 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.624408 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.624661 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.624787 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.624973 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.625097 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.625290 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.625423 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.625597 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.625788 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.625913 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.626221 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.626346 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.626527 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.626654 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.626849 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.626974 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.627159 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.627284 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.627495 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.627725 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.627863 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.628075 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.628200 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.628395 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.628529 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.628724 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.628850 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629053 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629179 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629363 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629497 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629670 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629794 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.629998 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.630129 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.630308 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.630434 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.630617 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.630748 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.630934 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.631067 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.631248 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.631375 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.631554 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.631718 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.631884 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632017 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632199 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632326 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632510 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632635 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632817 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.632954 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.633135 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.633260 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.633440 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.633564 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.633745 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.633880 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634061 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634185 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634367 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634552 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634668 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634798 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.634972 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.635104 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.635280 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.635405 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.635630 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.635772 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.635902 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636023 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636212 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636338 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636527 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636653 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636835 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.636967 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.637148 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.637283 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.637454 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.637579 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.638342 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.638506 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.638740 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.638920 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.639058 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.639268 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.639393 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.639596 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.639724 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.639936 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.640075 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.640250 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.640377 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.640559 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.640716 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.640875 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641008 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641188 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641311 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641509 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641633 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641822 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.641958 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.642129 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.642253 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.642449 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.642582 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.642799 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.642924 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.643065 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.643306 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.643464 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.643673 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.643810 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.644075 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.644201 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.644408 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.644657 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.644775 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.645013 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.645252 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.645379 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.645624 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.645806 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.645947 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.646226 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.646375 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.646553 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.646875 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.646999 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.647180 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.647503 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.647675 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.647831 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.648148 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.648273 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.648463 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.648748 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.648874 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.649084 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.649335 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.649469 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.649690 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.649920 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.650046 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.650292 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.650780 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.650921 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.651169 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.651389 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.651521 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.651849 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.652174 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.652311 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.652497 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.652845 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.652970 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.653156 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.653486 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.653628 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.653851 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.654071 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.654198 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:16:38.654454 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.654795 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.655132 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.655467 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.655826 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.656153 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.656472 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.656791 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.657128 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.657453 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.657791 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.658113 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.658428 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.658860 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.659181 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.659507 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.659863 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.660181 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.660517 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.660861 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.661194 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.661525 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.661836 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.662147 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.662458 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.662773 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.663126 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.663467 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.663817 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.664147 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.664464 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.664785 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.665098 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.665411 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.665724 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.666040 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.666362 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.666677 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.667002 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.667318 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.667666 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.667981 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.668306 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.668614 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.668973 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.669509 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.669926 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.670275 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.670595 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.670923 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.671237 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.672772 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.672772 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.672772 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.672772 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.673067 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.673158 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.673462 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.673778 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.674094 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.674407 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.674727 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.675039 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.675354 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.675723 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.676060 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.676373 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.676501 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_db.sqlalchemy.engines [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:38.676705 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.677029 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.677372 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.677685 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.677998 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.678334 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.678649 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.678969 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.679285 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.679619 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.679942 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.680261 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.680591 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.680919 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.681248 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.681579 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.681929 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.682246 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.682596 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.682927 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:16:38.683176 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:16:38.706405 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_db.sqlalchemy.engines [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:38.753473 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.context [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77f53108-6070-4f98-9489-b65bf1d32c10(cell1) {{(pid=92341) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:16:38.757580 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_concurrency.lockutils [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:16:38.759171 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_concurrency.lockutils [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:16:38.760006 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_concurrency.lockutils [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:16:38.761935 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_concurrency.lockutils [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:16:38.772014 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_db.sqlalchemy.engines [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:38.774417 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_db.sqlalchemy.engines [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:38.785141 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.context [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77f53108-6070-4f98-9489-b65bf1d32c10(cell1) {{(pid=92342) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:16:38.789364 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:16:38.790954 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:16:38.791797 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:16:38.793731 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:16:38.806776 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_db.sqlalchemy.engines [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:38.809276 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_db.sqlalchemy.engines [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:39.126873 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG oslo_db.sqlalchemy.engines [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:39.166623 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_db.sqlalchemy.engines [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:16:39.473758 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: WARNING keystonemiddleware.auth_token [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:16:39.480154 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: WARNING keystonemiddleware.auth_token [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:16:39.499955 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: WARNING keystonemiddleware.auth_token [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:16:39.507089 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: WARNING keystonemiddleware.auth_token [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:16:39.824183 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: WARNING keystonemiddleware.auth_token [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:16:39.829998 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: WARNING keystonemiddleware.auth_token [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:16:39.835224 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561577b879c0 pid: 92341 (default app) Jul 28 09:16:39.837397 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:16:39.838584 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jul 28 09:16:39.839007 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 789 bytes} [Wed Jul 28 09:16:39 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:16:39.861683 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: WARNING keystonemiddleware.auth_token [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:16:39.866850 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: WARNING keystonemiddleware.auth_token [None req-6cdac535-fd01-4037-a3e5-aa6af094ded7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:16:39.873147 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561577b879c0 pid: 92342 (default app) Jul 28 09:17:59.321586 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:59.322576 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 28 09:17:59.322978 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:17:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:17:59.762906 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-3fab995a-02f1-41ee-b9d7-55c138ad336c admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:17:59.793103 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-3fab995a-02f1-41ee-b9d7-55c138ad336c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462930 Jul 28 09:17:59.793864 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Jul 28 09:17:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:02.083934 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:02.084945 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-f87e8547-3eb1-4aa9-b772-c1a27acc47e8 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 28 09:18:02.086773 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:02 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:02.146256 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-5d2401cd-b62e-4050-a30c-ff85c3299ec0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "vcpus": 1, "name": "cirros256"}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:02.165249 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:18:02.165249 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: warnings.warn(msg) Jul 28 09:18:02.198597 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-5d2401cd-b62e-4050-a30c-ff85c3299ec0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105600 Jul 28 09:18:02.199511 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:02.422208 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-cb09100a-165f-42f7-81a9-ac00d5515cca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:02.424584 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:18:02.424584 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: warnings.warn(msg) Jul 28 09:18:02.477805 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-cb09100a-165f-42f7-81a9-ac00d5515cca admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269598 Jul 28 09:18:02.483797 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Jul 28 09:18:02 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:04.901103 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-5d2401cd-b62e-4050-a30c-ff85c3299ec0 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:04.902151 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-5d2401cd-b62e-4050-a30c-ff85c3299ec0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 28 09:18:04.902571 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:05.046742 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-1013912f-57b9-4cc1-8c72-ab13020d07ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:05.064843 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:18:05.064843 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: warnings.warn(msg) Jul 28 09:18:05.083691 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-1013912f-57b9-4cc1-8c72-ab13020d07ae admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.174406 Jul 28 09:18:05.084174 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:05.097492 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b007eabc-fd0e-4a8b-9d47-6aec81a3ac2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:05.099102 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:18:05.099102 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: warnings.warn(msg) Jul 28 09:18:05.130729 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b007eabc-fd0e-4a8b-9d47-6aec81a3ac2b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037267 Jul 28 09:18:05.131331 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Jul 28 09:18:05 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:07.333319 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-1013912f-57b9-4cc1-8c72-ab13020d07ae admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:07.334345 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-1013912f-57b9-4cc1-8c72-ab13020d07ae admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 28 09:18:07.334751 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:18:07.394534 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-8f9bffed-c3e3-4ae1-8e05-b587ec7297be admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:07.415169 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-8f9bffed-c3e3-4ae1-8e05-b587ec7297be admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073385 Jul 28 09:18:07.415969 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:07 2021] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:18:07.428204 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-5c49cb4b-3f03-48c8-b7f8-62dcef0b5690 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:07.452160 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-5c49cb4b-3f03-48c8-b7f8-62dcef0b5690 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027868 Jul 28 09:18:07.460330 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Jul 28 09:18:07 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:09.664299 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-8f9bffed-c3e3-4ae1-8e05-b587ec7297be admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:09.665331 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-8f9bffed-c3e3-4ae1-8e05-b587ec7297be admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Jul 28 09:18:09.665741 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:09.722929 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-65ea1924-b891-4519-a75a-4aad51892ea9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:09.744621 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-65ea1924-b891-4519-a75a-4aad51892ea9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072133 Jul 28 09:18:09.745183 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:09.757410 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-baf2004a-9323-4b62-bd53-d7ff55bd4c2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:09.781644 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-baf2004a-9323-4b62-bd53-d7ff55bd4c2d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027995 Jul 28 09:18:09.782389 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Jul 28 09:18:09 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:11.984335 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-65ea1924-b891-4519-a75a-4aad51892ea9 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:11.985348 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-65ea1924-b891-4519-a75a-4aad51892ea9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 28 09:18:11.986017 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:12.044949 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-a0d39591-d906-4f03-a6f0-76ac5f0fe023 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:12.063097 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-a0d39591-d906-4f03-a6f0-76ac5f0fe023 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070084 Jul 28 09:18:12.063915 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:12.077060 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-eb12b211-e002-4931-8c3a-3616816e2cd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:12.101845 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-eb12b211-e002-4931-8c3a-3616816e2cd8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028517 Jul 28 09:18:12.102656 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Jul 28 09:18:12 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:14.289754 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-a0d39591-d906-4f03-a6f0-76ac5f0fe023 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:14.290747 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-a0d39591-d906-4f03-a6f0-76ac5f0fe023 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 28 09:18:14.291140 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:14.350779 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-e524b6fb-bb1a-495a-a257-51ac7afde5a2 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:14.376395 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-e524b6fb-bb1a-495a-a257-51ac7afde5a2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078747 Jul 28 09:18:14.382982 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Jul 28 09:18:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:18:16.593940 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-a0d39591-d906-4f03-a6f0-76ac5f0fe023 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:16.594965 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-a0d39591-d906-4f03-a6f0-76ac5f0fe023 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 28 09:18:16.595381 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:16.655749 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-46981360-4f6b-4e7e-97d2-cff31fa30fb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "disk": 1, "ram": 512}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:16.674603 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-46981360-4f6b-4e7e-97d2-cff31fa30fb0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072654 Jul 28 09:18:16.675165 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:16 2021] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:18:16.691451 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-c7a35a1e-8535-4aad-b8eb-9ae1c8e74409 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:16.720588 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-c7a35a1e-8535-4aad-b8eb-9ae1c8e74409 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034070 Jul 28 09:18:16.721408 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Jul 28 09:18:16 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:18.954216 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-46981360-4f6b-4e7e-97d2-cff31fa30fb0 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:18.955882 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-46981360-4f6b-4e7e-97d2-cff31fa30fb0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jul 28 09:18:18.956293 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:19.023280 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-8a7988ef-3c37-4240-aee4-63c454eef9aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:19.044684 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-8a7988ef-3c37-4240-aee4-63c454eef9aa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081000 Jul 28 09:18:19.045409 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:18 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:18:19.057843 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-8bf946dc-1593-4672-b768-5cbe5b7e0510 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:19.082981 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-8bf946dc-1593-4672-b768-5cbe5b7e0510 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029415 Jul 28 09:18:19.083649 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Jul 28 09:18:19 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:21.601240 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-8a7988ef-3c37-4240-aee4-63c454eef9aa admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:21.602403 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-8a7988ef-3c37-4240-aee4-63c454eef9aa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Jul 28 09:18:21.602909 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:21.660875 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-293c0c31-5363-4b6c-a5df-534ee1b738e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:21.678384 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-293c0c31-5363-4b6c-a5df-534ee1b738e4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067885 Jul 28 09:18:21.678967 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:21 2021] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:18:21.691259 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-852f086f-b53d-4381-9e34-afec842086db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:21.714460 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-852f086f-b53d-4381-9e34-afec842086db admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026809 Jul 28 09:18:21.715198 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Jul 28 09:18:21 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:23.893744 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-293c0c31-5363-4b6c-a5df-534ee1b738e4 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:23.894912 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-293c0c31-5363-4b6c-a5df-534ee1b738e4 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Jul 28 09:18:23.895524 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:23.956314 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-28c090e1-c154-4ed7-b92b-2cbfb4bf308f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "disk": 80, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:23.977030 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-28c090e1-c154-4ed7-b92b-2cbfb4bf308f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072357 Jul 28 09:18:23.983406 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:23.988301 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-f37e263f-84a0-4a61-906a-3ec8270868bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:24.011380 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-f37e263f-84a0-4a61-906a-3ec8270868bb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026767 Jul 28 09:18:24.012106 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Jul 28 09:18:23 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:26.230035 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-28c090e1-c154-4ed7-b92b-2cbfb4bf308f admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:18:26.231656 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-28c090e1-c154-4ed7-b92b-2cbfb4bf308f admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Jul 28 09:18:26.232213 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:18:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:18:26.292767 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-a9a1e0e3-13b9-4fea-9278-7bb6d6875bfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:26.312405 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-a9a1e0e3-13b9-4fea-9278-7bb6d6875bfa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073467 Jul 28 09:18:26.313271 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Jul 28 09:18:26 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:18:26.326081 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-c2954435-7250-4052-aafe-70a19c2df682 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:18:26.352315 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-c2954435-7250-4052-aafe-70a19c2df682 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029739 Jul 28 09:18:26.352891 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Jul 28 09:18:26 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:05.136902 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-a9a1e0e3-13b9-4fea-9278-7bb6d6875bfa admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:05.137902 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-a9a1e0e3-13b9-4fea-9278-7bb6d6875bfa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 28 09:19:05.138303 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:19:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:05.198035 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-8606bc1b-bca8-4288-8027-85970d62d2e4 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:05.215166 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-8606bc1b-bca8-4288-8027-85970d62d2e4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070414 Jul 28 09:19:05.215725 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Jul 28 09:19:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:06.633797 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-a9a1e0e3-13b9-4fea-9278-7bb6d6875bfa admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:06.634789 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-a9a1e0e3-13b9-4fea-9278-7bb6d6875bfa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jul 28 09:19:06.635186 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:06.822819 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-16177bfa-10a1-4a86-abbe-db97ad6162cd admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:06.828278 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.wsgi [None req-16177bfa-10a1-4a86-abbe-db97ad6162cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 09:19:06.828845 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-16177bfa-10a1-4a86-abbe-db97ad6162cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:19:06.829630 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-16177bfa-10a1-4a86-abbe-db97ad6162cd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.056886 Jul 28 09:19:06.830132 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Jul 28 09:19:06 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 09:19:06.839937 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-5651219f-9467-4adf-bb5e-c8fd93298852 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:06.861658 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-5651219f-9467-4adf-bb5e-c8fd93298852 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025097 Jul 28 09:19:06.862121 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Jul 28 09:19:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:06.873087 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-5469b973-85dc-4005-82ae-14af3ffebb1a admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:06.894373 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-5469b973-85dc-4005-82ae-14af3ffebb1a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024933 Jul 28 09:19:06.895372 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Jul 28 09:19:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:19:06.905285 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-d23ea265-9662-4e40-a7d0-eed5235ac6d4 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:06.911099 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.wsgi [None req-d23ea265-9662-4e40-a7d0-eed5235ac6d4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 09:19:06.911687 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-d23ea265-9662-4e40-a7d0-eed5235ac6d4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:19:06.912462 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-d23ea265-9662-4e40-a7d0-eed5235ac6d4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010725 Jul 28 09:19:06.912942 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Jul 28 09:19:06 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 09:19:08.255234 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-5469b973-85dc-4005-82ae-14af3ffebb1a admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:08.256315 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-5469b973-85dc-4005-82ae-14af3ffebb1a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jul 28 09:19:08.256716 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:08.443880 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-943f9832-ea82-4557-8f21-12b84c1e00d2 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:08.449074 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.wsgi [None req-943f9832-ea82-4557-8f21-12b84c1e00d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 09:19:08.449645 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-943f9832-ea82-4557-8f21-12b84c1e00d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:19:08.450435 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-943f9832-ea82-4557-8f21-12b84c1e00d2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.056033 Jul 28 09:19:08.450933 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Jul 28 09:19:08 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:19:08.460734 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-4ae0c8b3-998e-464a-b613-6c0239abc9f4 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:08.474685 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-4ae0c8b3-998e-464a-b613-6c0239abc9f4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017605 Jul 28 09:19:08.475154 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Jul 28 09:19:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:08.485066 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-74e5db9e-2367-417f-ac7d-b3abe6899aff admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:08.499523 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-74e5db9e-2367-417f-ac7d-b3abe6899aff admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017916 Jul 28 09:19:08.500090 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Jul 28 09:19:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:08.509800 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-2fad64a3-d3eb-4b3d-9ffe-02cc03cbef78 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:08.515101 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.wsgi [None req-2fad64a3-d3eb-4b3d-9ffe-02cc03cbef78 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 09:19:08.515507 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-2fad64a3-d3eb-4b3d-9ffe-02cc03cbef78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:19:08.516319 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-2fad64a3-d3eb-4b3d-9ffe-02cc03cbef78 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010068 Jul 28 09:19:08.516808 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Jul 28 09:19:08 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 09:19:09.839276 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-74e5db9e-2367-417f-ac7d-b3abe6899aff admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:09.840330 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-74e5db9e-2367-417f-ac7d-b3abe6899aff admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 28 09:19:09.840722 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:10.027703 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-1b32d4a0-8f83-481a-bb40-d4499bcfb50e admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:10.033233 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.wsgi [None req-1b32d4a0-8f83-481a-bb40-d4499bcfb50e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 09:19:10.033789 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-1b32d4a0-8f83-481a-bb40-d4499bcfb50e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:19:10.034565 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-1b32d4a0-8f83-481a-bb40-d4499bcfb50e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.057040 Jul 28 09:19:10.035070 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Jul 28 09:19:09 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 09:19:10.044607 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-6decbded-2748-4726-80ae-b23bbfa752eb admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:10.058397 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-6decbded-2748-4726-80ae-b23bbfa752eb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017203 Jul 28 09:19:10.058858 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Jul 28 09:19:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:19:10.068791 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:10.082996 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018138 Jul 28 09:19:10.083501 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Jul 28 09:19:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:19:10.093105 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-6eb3d3fc-52e1-4f19-8384-d48262166124 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:10.098224 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.wsgi [None req-6eb3d3fc-52e1-4f19-8384-d48262166124 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 09:19:10.098776 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-6eb3d3fc-52e1-4f19-8384-d48262166124 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:19:10.099543 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-6eb3d3fc-52e1-4f19-8384-d48262166124 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009850 Jul 28 09:19:10.100051 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Jul 28 09:19:10 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 09:19:11.446139 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:11.447142 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 28 09:19:11.447536 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:11.645134 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-ff8abb49-fa31-4d0a-b43d-968dad91418d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:11.663951 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-ff8abb49-fa31-4d0a-b43d-968dad91418d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.068325 Jul 28 09:19:11.664425 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Jul 28 09:19:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:13.001966 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:13.002971 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 28 09:19:13.003367 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:13.189269 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-ebcb718b-847a-4fd3-994a-7e93c86bbbbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:13.207239 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-ebcb718b-847a-4fd3-994a-7e93c86bbbbf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.067522 Jul 28 09:19:13.208117 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Jul 28 09:19:13 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:14.540647 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:14.541659 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 28 09:19:14.542057 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:14.730194 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-87571c69-9570-409c-a9e8-44307f8a51d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:14.747786 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-87571c69-9570-409c-a9e8-44307f8a51d2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.066703 Jul 28 09:19:14.748266 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Jul 28 09:19:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:16.087255 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:16.088282 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 28 09:19:16.088670 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:16.275372 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-72cfb3c3-933d-4fc6-b9d8-e274403c30be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:19:16.291932 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-72cfb3c3-933d-4fc6-b9d8-e274403c30be admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.066612 Jul 28 09:19:16.292460 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Jul 28 09:19:16 2021] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:17.638015 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:17.639069 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 28 09:19:17.639466 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:19:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:19:17.825671 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-0d7bbc1d-a9fc-4e0f-8b94-d27dd9c8cd40 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:19:17.844743 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-0d7bbc1d-a9fc-4e0f-8b94-d27dd9c8cd40 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.067542 Jul 28 09:19:17.845267 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1203 bytes} [Wed Jul 28 09:19:17 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:04.073281 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:04.074290 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-b4f14ea6-78a5-4580-b933-d007a65efa60 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 28 09:20:04.074682 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Wed Jul 28 09:20:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:20:04.138496 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-f4ac4cea-bac7-41d2-83a1-c083317c4b99 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:04.162404 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-f4ac4cea-bac7-41d2-83a1-c083317c4b99 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079565 Jul 28 09:20:04.162953 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Jul 28 09:20:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:20:04.184868 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-950e1273-c846-4268-b1e1-74cbee0d2ed8 admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:04.193093 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-950e1273-c846-4268-b1e1-74cbee0d2ed8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011785 Jul 28 09:20:04.193601 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Wed Jul 28 09:20:04 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:04.206439 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-4e9f9e36-8f11-47b9-befe-8b2cca300335 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:04.214190 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-4e9f9e36-8f11-47b9-befe-8b2cca300335 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012202 Jul 28 09:20:04.214704 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Wed Jul 28 09:20:04 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:20:04.226177 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-26a516d1-6b59-442f-9fa8-ed1626ff646f admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:04.233833 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-26a516d1-6b59-442f-9fa8-ed1626ff646f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011108 Jul 28 09:20:04.234344 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Wed Jul 28 09:20:04 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:20:04.246098 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-c92e33bb-3280-403e-943f-9fa098c9a325 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:20:04.254361 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-c92e33bb-3280-403e-943f-9fa098c9a325 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011857 Jul 28 09:20:04.254865 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Wed Jul 28 09:20:04 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:21:23.257296 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-57a1b7d1-2eea-4dbc-a2e4-5efae6eabfd2 tempest-verify_tempest_config-57478442 tempest-verify_tempest_config-57478442-project] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:21:23.259278 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-57a1b7d1-2eea-4dbc-a2e4-5efae6eabfd2 tempest-verify_tempest_config-57478442 tempest-verify_tempest_config-57478442-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104164 Jul 28 09:21:23.259841 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Jul 28 09:21:23 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:22:52.366272 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-c92e33bb-3280-403e-943f-9fa098c9a325 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:52.367311 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-c92e33bb-3280-403e-943f-9fa098c9a325 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 28 09:22:52.367750 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:22:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:52.620084 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-9ed22cfc-71c6-4c8b-a4d1-26b6bb3b9b7c admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:52.621227 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:22:52.621227 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: warnings.warn(msg) Jul 28 09:22:52.622768 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-9ed22cfc-71c6-4c8b-a4d1-26b6bb3b9b7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:22:52.623316 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-9ed22cfc-71c6-4c8b-a4d1-26b6bb3b9b7c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:22:52.624127 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-9ed22cfc-71c6-4c8b-a4d1-26b6bb3b9b7c admin admin] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:22:52.624547 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-9ed22cfc-71c6-4c8b-a4d1-26b6bb3b9b7c admin admin] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:22:52.663386 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-9ed22cfc-71c6-4c8b-a4d1-26b6bb3b9b7c admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.151593 Jul 28 09:22:52.663953 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Jul 28 09:22:52 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:22:54.008319 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: DEBUG nova.api.openstack.wsgi [None req-c92e33bb-3280-403e-943f-9fa098c9a325 admin admin] Calling method '>' {{(pid=92341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:54.009317 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: INFO nova.api.openstack.requestlog [None req-c92e33bb-3280-403e-943f-9fa098c9a325 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 28 09:22:54.009710 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: [pid: 92341|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Jul 28 09:22:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:22:54.206515 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG nova.api.openstack.wsgi [None req-17a266b9-74b3-4db0-a40d-e7d5ccaaf85d admin admin] Calling method '>' {{(pid=92342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:22:54.208463 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:22:54.208463 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: warnings.warn(msg) Jul 28 09:22:54.211074 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-17a266b9-74b3-4db0-a40d-e7d5ccaaf85d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:22:54.211528 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-17a266b9-74b3-4db0-a40d-e7d5ccaaf85d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:22:54.212355 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-17a266b9-74b3-4db0-a40d-e7d5ccaaf85d admin admin] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:22:54.212784 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: DEBUG oslo_concurrency.lockutils [None req-17a266b9-74b3-4db0-a40d-e7d5ccaaf85d admin admin] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:22:54.234170 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: INFO nova.api.openstack.requestlog [None req-17a266b9-74b3-4db0-a40d-e7d5ccaaf85d admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.083360 Jul 28 09:22:54.234650 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: [pid: 92342|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Jul 28 09:22:54 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:23:48.534755 dv-cinder-802669-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 09:23:48.535371 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: Wed Jul 28 09:23:48 2021 - graceful shutdown triggered... Jul 28 09:23:48.535876 dv-cinder-802669-1-iscsi devstack@n-api.service[92341]: Gracefully killing worker 1 (pid: 92341)... Jul 28 09:23:48.536250 dv-cinder-802669-1-iscsi devstack@n-api.service[92342]: Gracefully killing worker 2 (pid: 92342)... Jul 28 09:23:49.536031 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: worker 1 buried after 1 seconds Jul 28 09:23:49.536031 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: worker 2 buried after 1 seconds Jul 28 09:23:49.536031 dv-cinder-802669-1-iscsi devstack@n-api.service[92340]: goodbye to uWSGI. Jul 28 09:23:49.537967 dv-cinder-802669-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 09:23:49.539093 dv-cinder-802669-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 09:23:49.542122 dv-cinder-802669-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 09:23:49.555370 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 09:23:49 2021] *** Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: nodename: dv-cinder-802669-1-iscsi Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: machine: x86_64 Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: clock source: unix Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: pcre jit disabled Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: detected number of CPU cores: 4 Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: current working directory: / Jul 28 09:23:49.557253 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: detected binary path: /usr/bin/uwsgi-core Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: your processes number limit is 47680 Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: your memory page size is 4096 bytes Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: detected max file descriptor number: 2048 Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: lock engine: pthread robust mutexes Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: thunder lock: enabled Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 09:23:49.558012 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 09:23:49.603558 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: Python main interpreter initialized at 0x5566e1fa09c0 Jul 28 09:23:49.603558 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: python threads support enabled Jul 28 09:23:49.603558 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: your server socket listen backlog is limited to 100 connections Jul 28 09:23:49.603558 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: your mercy for graceful operations on workers is 90 seconds Jul 28 09:23:49.604026 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 09:23:49.604026 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: *** Operational MODE: preforking *** Jul 28 09:23:49.604307 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: *** uWSGI is running in multiple interpreter mode *** Jul 28 09:23:49.604307 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: spawned uWSGI master process (pid: 107280) Jul 28 09:23:49.607779 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: spawned uWSGI worker 1 (pid: 107292, cores: 1) Jul 28 09:23:49.607779 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: spawned uWSGI worker 2 (pid: 107293, cores: 1) Jul 28 09:23:49.607779 dv-cinder-802669-1-iscsi devstack@n-api.service[107280]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 09:23:49.604516 dv-cinder-802669-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 09:23:51.432055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:23:51.432055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: from cryptography.utils import int_from_bytes Jul 28 09:23:51.432602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:23:51.432602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: from cryptography.utils import int_from_bytes Jul 28 09:23:51.480291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:23:51.480291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: from cryptography.utils import int_from_bytes Jul 28 09:23:51.480925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:23:51.480925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: from cryptography.utils import int_from_bytes Jul 28 09:23:53.957159 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:23:53.957683 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:23:53.957993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:23:53.958215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:23:53.958440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:23:53.958837 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.959172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.959506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.959864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.961084 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.961720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.962059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.962392 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.962733 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.963003 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.963329 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.963689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802669-1-iscsi {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.964035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.964344 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.964665 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.964993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.965305 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.965634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.965948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.966459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.967934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.967934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.967934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.968205 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.968533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.968864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.969181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.969560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.969823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.970144 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.970646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802669-1-iscsi {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.970959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.971325 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.971634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.972115 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.972382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.972705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.973019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.973375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.973669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.974006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.974342 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.974668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.975003 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.975301 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.975638 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.975996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.976326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.976670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.976959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.977217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.977533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.977864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.978195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.978527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.978785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.979043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.979370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.979724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.980044 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.980362 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.980681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.981012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.981317 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.981635 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.981949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.982264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.982590 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.982916 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.983243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.983558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.983917 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.984327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.984592 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.984904 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.985259 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.985583 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.985902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.986231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.986558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.986881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.987196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.987511 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.987871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.988204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.988519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.988776 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.989086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.989397 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.989724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.990037 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.990351 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.990663 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.990970 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.991286 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.991697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.991968 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.992325 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.992608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.992911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.993254 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.993533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.993846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.994175 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.994506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.994822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.995131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.995445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.995779 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.996108 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.996423 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.996737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.997064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.997378 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.997691 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.998023 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.998323 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.998636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.998963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.999270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.999599 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:53.999932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.000246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.000560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.000871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.001185 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.001499 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.001824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.002123 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.002435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.002737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.003068 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.003411 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.003740 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.004054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.004368 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.004697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.005044 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.005383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.005737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.006055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.006400 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.006739 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.007625 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.007943 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.008267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.008603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.008925 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.009246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.009565 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.009891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.010220 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.010559 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.010884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.011210 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.011554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.011945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.012219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.012564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.012893 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.013215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.014059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.014194 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.014519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.014859 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.015178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.015507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.015930 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.016178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.016497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.016823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.017143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.017464 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.017811 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.018136 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.018461 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.018774 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.019088 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.019401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.019747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.020061 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.020389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.020724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.021038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.021379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.021697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.022077 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.022334 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.023265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.023528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.023881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.024196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.024527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.024849 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.025180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.025489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.025803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.026117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.026439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.026654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:23:54.027075 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.027429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:23:54.027518 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.027641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:23:54.027743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.027979 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.028085 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:23:54.028242 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:23:54.028343 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.028606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.028709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.028945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.029048 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.029267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.029360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.029584 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.029691 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.029917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.030017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.030230 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.030335 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.030550 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.030641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.030861 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.030944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.031181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.031272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.031439 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.031521 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.031798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.031906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.032190 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-802669-1-iscsi {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.032288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.032439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.032524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.032746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.032851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.033059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.033160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.033369 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.033454 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.033674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.033775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.033983 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.034079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.034458 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.034613 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.034613 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.034898 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.035059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.035231 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.035473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.035689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.035852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.036025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.036258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.036412 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.036557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.036708 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.036859 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.037004 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.037160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.037323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.037481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.037638 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.037790 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.037943 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.038256 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.038430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.038586 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.038738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-802669-1-iscsi {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.038893 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.038893 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.039200 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.039344 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.039488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.039667 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.039826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.039981 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.040127 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.040279 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.040435 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.040589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.040747 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.040901 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.041045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.041196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.041350 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.041502 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.041667 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.041839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.042063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.042369 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.042522 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.042685 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.042850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.043008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.043243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.043403 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.043558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.043824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.044000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.044148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.044299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.044444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.044594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.044753 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.044989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.045148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.045294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.045476 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.045840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.045994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.046157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.046405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.046566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.046720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.046878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.047032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.047211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.047382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.047529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.047529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.047932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.048089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.048341 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.048511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.048658 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.048811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.048965 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.049124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.049270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.049422 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.049573 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.049718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.049869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.050025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.050178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.050334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.050489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.050634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.050777 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.050930 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.051076 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.051220 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.051377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.051521 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.051705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.051854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.051997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.052239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.052569 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.052720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.052876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.052876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.053160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.053160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.053553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.053706 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.054459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.054665 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.054823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.055145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.055304 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.055463 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.055641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.055888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.056039 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.056184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.056328 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.056557 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.056722 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.056921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.057079 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.057233 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.057386 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.057540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.057704 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.057850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.058030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.058248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.058507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.058667 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.058947 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.059146 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.059303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.059451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.059634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.059798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.059945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.060141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.060293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.060444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.060444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.060737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.060891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.061037 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.061186 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.061344 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.061505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.061664 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.061816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.061978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.062130 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.062393 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.062723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.062884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.063043 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.063203 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.063355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.063355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.063788 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.063989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.064141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.064332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.064583 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.064583 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.064899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.065060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.065213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.065213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.065509 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.065669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.065829 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.066070 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.066227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.066430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.066668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.066840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.067017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.067274 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.067460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.067662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.067830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.067830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.068145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.068298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.068575 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.068744 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.068914 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.069073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.069248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.069400 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.069644 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.070463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.070628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.070851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.071013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.071013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.071321 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.071321 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.071630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.071799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.071963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.071963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.072263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.072506 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.072852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.073025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.073181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.073343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.073497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.074323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.074486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.074738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.074913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.075160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.075326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.075763 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.075929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.076100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.076332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.076542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.076827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.076987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.077139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.077346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.077515 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.077674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.077835 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.077996 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:23:54.078160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.078314 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.078473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.078653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.078923 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.079089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.079250 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.079405 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.079591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.079772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.079973 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.080137 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.080289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.080455 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.080608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.080795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.080958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.081117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.081269 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.081433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.081586 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.081752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.081910 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.082062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.082221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.082373 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.082541 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.082792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.083111 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.083274 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.083436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.083616 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.083871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.084042 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.084207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.084359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.084523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.084686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.084958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.085180 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.085342 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.085561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.085749 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.085912 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.086065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.086217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.086473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.086658 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.086832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.087288 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.087460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.087655 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.087815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.087815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.088134 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.088281 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.088610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.088775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.088947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089327 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089599 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.089919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090092 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.090984 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091171 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091460 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091861 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.091861 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092031 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092565 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092770 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.092859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093253 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.093975 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094072 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094159 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094419 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094500 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.094928 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095010 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095205 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095283 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095369 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095453 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.095923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096058 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096150 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096311 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096580 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096658 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096750 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096844 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.096939 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097120 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097312 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097411 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097581 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097675 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097768 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097861 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.097968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098230 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098407 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098571 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098845 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.098931 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099015 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099469 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099555 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.099839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100169 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100359 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100847 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.100936 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101015 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101575 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101855 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.101944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102129 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102213 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102853 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.102946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.103202 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.103320 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.103471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.103653 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.103803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.103909 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.104118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.104235 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.104442 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.104543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.104779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.104872 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.105094 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.105199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.105409 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.105510 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.105734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.105828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106147 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106761 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.106975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.107086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.107282 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.107383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.107610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.107720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.107931 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108245 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108659 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108865 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.108958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.109183 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.109376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.109489 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.109701 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.109818 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.110018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.110123 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.110350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.110450 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.110681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.110784 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111115 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111328 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111422 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111678 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111793 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.111985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.112076 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.112296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.112443 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.112619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113486 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113646 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113808 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.113958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.114179 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.114452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.114758 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.115077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.115401 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.115661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.115778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.116049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.116158 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.117018 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.117172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.117350 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.117616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.117717 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.117980 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.118086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.118294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.118547 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.118650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.118787 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.118906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.119140 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.119230 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.119494 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.119667 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.119860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.120121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.120212 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.120323 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.120475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.120677 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.120789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.121082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.121182 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.121390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.121488 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.121707 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.121812 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.122059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.122292 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.122386 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.122627 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.122767 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.122945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.123112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.123269 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.123438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.123610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.123787 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.123935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.124270 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.124383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.124597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.124690 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.124912 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.125018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.125222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.125387 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.125531 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.125743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.125848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.126086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.126178 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.126408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.126540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.126723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.126823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127155 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127681 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127847 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.127989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.128082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.128295 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.128427 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.128600 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.128757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.128905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.129097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.129220 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.129447 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.129546 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.129792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.129900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.130121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.130250 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.130448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.130607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.130758 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.130949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.131054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.131280 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.131373 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.131666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.131762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.132085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.132242 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.132408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.132563 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.132754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.132855 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.133094 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.133186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.133438 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.133545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.133746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.133839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.134055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.134148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.134384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.134585 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.134679 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.134909 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.135009 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.135227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.135319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.135586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.135693 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.135906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136313 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136632 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.136940 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.137164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.137269 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.137475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.137566 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.137780 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.137886 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.138094 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.138186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.138402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.138501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.138721 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.138827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139032 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139157 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139866 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.139972 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.140270 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.140382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.140573 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.140679 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.140885 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.140976 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.141188 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.141287 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.141511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.141652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.141819 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.141953 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.142124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.142277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.142429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.142604 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.142742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.142934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.143054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.143262 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.143426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.143610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.143779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.143961 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.144084 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.144389 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.144516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.144708 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145016 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145322 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145421 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145635 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145778 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.145962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.146113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.146281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.146448 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.146590 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.146784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.146902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.147112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.147215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.147438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.147552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.148339 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.148437 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.148669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.148882 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.148992 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.149203 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.149303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.149976 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150174 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150255 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150336 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150415 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.150823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.151039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.151129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.151356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.151459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.151692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.151804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.152006 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.152405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.152609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.152742 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.152919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.153069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.153287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.153408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.153595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.153751 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.153918 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.154088 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.154243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.154563 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.154669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.154883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.155008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.155196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.155301 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.155505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.155635 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.155854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.156009 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.156169 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.156346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.156476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.156677 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.156783 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.157009 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.157111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.157355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.157456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.157711 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.157896 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.158055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.158446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.158595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.158718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.158836 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.159020 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.159131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.159594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.159705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.159911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.160030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.160228 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.160560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.160682 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.160850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.160957 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.161503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.161590 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.161673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.161746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.161836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.161912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.162243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.162370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.162560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.162676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.162878 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.162975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.163272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.163690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.163898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.164079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.164316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.164508 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.164675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.164953 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.165261 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.165453 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.165639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.165876 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.166048 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.166204 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.166487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.166664 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.166822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.167191 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.167402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.167602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.167853 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.168043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.168211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.168427 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.168591 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.168767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.169101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.169355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.169465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.169699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.169828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.170125 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.170352 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.170659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.170829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.171043 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.171206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.171362 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.171672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.171832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.171987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.172268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.172451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.172606 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.172829 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.172990 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.173182 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.173404 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.173593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.173803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.174018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.174177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.174513 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.174688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.174853 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.175136 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.175293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.175555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.175821 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.175982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.176194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.176472 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.176637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.176830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.177024 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.177183 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.177452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.177633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.177785 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.178071 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.178231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.178397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.178635 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.179325 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.179538 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.179884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.180144 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.180247 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.180495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.180595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.180822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.181015 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.181122 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.181355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.181466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.181706 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.181860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.182042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.182189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.182374 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.182503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.182837 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.183165 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.183476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.183828 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.184019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.184153 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.184388 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.184488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.184730 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.184828 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.185062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.185182 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.185367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.185482 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.185687 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.185785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186004 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186322 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186415 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.186941 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.187034 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.187263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.187364 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.187614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.187725 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.187916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.188009 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.188229 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.188331 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.188553 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.188661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.188884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189186 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189297 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189622 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.189974 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.190133 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.190277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.190440 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.190751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.190898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.191098 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.191201 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.191407 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.191755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.191877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.192093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.192195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.192424 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.192526 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.192733 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.192835 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.193068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.193161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.193396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.193509 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.193716 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.193817 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.194029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.194143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.194353 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.194473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.195254 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.195357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.195567 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.195800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.195908 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.196131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.196247 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.196455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.196557 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.196779 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.196873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.197091 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.197193 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.197401 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.197501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.197706 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.197799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198335 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198428 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198742 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.198968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.199062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.199279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.199374 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.199606 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.199719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.199914 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200015 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200679 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200874 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.200975 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.201200 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.201292 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.201518 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.201624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.201844 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.201950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.202161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.202253 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.202470 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.202572 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.202795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.202885 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.203114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.203216 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.203430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.203532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.203791 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.203894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.204112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.204206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.204430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.204633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.204805 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.204984 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.205124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.205323 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.205426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.205656 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.205770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.205963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.206120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.206272 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.206376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.206582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.206897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.206991 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.207277 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.207394 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.207547 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.207672 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.207887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.207991 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.208204 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.208314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.208516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.208610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.208829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.209143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.209465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.209587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.209676 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.209750 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.209950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.210045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.210385 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.210501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.210625 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.210821 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.210949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.211165 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.211263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.211510 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.211646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.211880 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.211975 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.212201 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.212349 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.212520 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.212615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.212840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.212941 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.213155 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.213250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.213476 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.213578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.213791 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.213886 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.214121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.214223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.214429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.214556 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.214751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.214881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.215074 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.215208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.215392 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.215523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.215730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.215897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.216054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.216350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.216456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.216677 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.216771 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.216993 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.217101 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.217308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.217402 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.217620 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.217713 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.217960 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218279 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218381 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.218999 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.219220 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.219313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.219534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.219792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.219902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.220114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.220208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.220456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.220585 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.220789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.220896 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.221116 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.221207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.221432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.221534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.221753 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.221846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.222073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.222185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.222382 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.222489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.222692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.222785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223115 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223426 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.223964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.224058 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.224282 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.224384 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.224588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.224681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.224913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.225014 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.225226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.225320 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.225551 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.225869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.226059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.226312 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.226423 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.226595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.226734 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.226929 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.227085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.227263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.227452 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.227636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.227735 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:23:54.227923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.228253 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.228566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.228878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.229198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.229515 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.229823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.230130 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.230445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.230762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.231067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.231380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.231711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.232042 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.232351 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.232660 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.232968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.233281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.233589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.233898 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.234206 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.234512 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.234825 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.235131 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.235444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.235772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.236092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.236396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.236710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.237017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.237347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.237657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.237963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.238286 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.238588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.238912 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.239225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.239541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.240125 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.240447 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.240998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.241892 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.242500 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.242944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.243305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.243648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.244474 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.244474 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.244767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.244913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.245189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.245506 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.245822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.246139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.246453 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.246773 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.247081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.247397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.247796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.248147 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.248471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.248791 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.249112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.249431 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.249743 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.250059 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.250369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.250697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.251019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.251356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.251710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.251907 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.252063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.252427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.252743 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.253066 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.253410 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.253709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.254046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.254391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.254723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.255050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.255360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.255697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.256007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.256323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.256665 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.257609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.257936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.258264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.258579 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.258900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.259255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.259530 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.259868 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.260181 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.260505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.260820 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.261144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.261455 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.261786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.262096 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.262417 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.262723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.263040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.263352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.263692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.264031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.264349 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.264674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.264989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.265314 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.265628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.265955 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.266284 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.266607 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.266923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.267259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.267614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.267912 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.268227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.268542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.268855 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.269170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.269503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.269822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.270135 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.270463 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.270782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.271105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.271428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.271772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.272106 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.272421 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.273356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.273676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.273991 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.274311 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.274655 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.274965 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.275295 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.275649 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.275983 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.276386 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.276690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.277057 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.277643 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:23:54.277906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:23:54.301711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.426346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.context [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77f53108-6070-4f98-9489-b65bf1d32c10(cell1) {{(pid=107292) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:23:54.430668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:23:54.432303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:23:54.433107 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:23:54.435047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:23:54.446277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.447591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.470754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.context [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),77f53108-6070-4f98-9489-b65bf1d32c10(cell1) {{(pid=107293) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 09:23:54.475008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:23:54.477289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:23:54.478107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:23:54.480083 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:23:54.490525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.492216 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.721685 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_db.sqlalchemy.engines [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:54.756923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_db.sqlalchemy.engines [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:23:55.049319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:23:55.056472 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:23:55.083924 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:23:55.090652 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:23:55.412503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:23:55.417823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: WARNING keystonemiddleware.auth_token [None req-11ff87d8-b173-4728-bf40-fc74e1587a78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:23:55.423294 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566e1fa09c0 pid: 107292 (default app) Jul 28 09:23:55.437642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 09:23:55.442794 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: WARNING keystonemiddleware.auth_token [None req-5763e08d-188f-4382-aa53-8a27eee80735 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 09:23:55.448663 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566e1fa09c0 pid: 107293 (default app) Jul 28 09:24:27.460800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9daed2c0-c120-4305-94a7-3022f982ec2d tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Action: 'create', calling method: .version_select at 0x7f16d242d160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-576373031", "metadata": {"Type": "work"}}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:27.462512 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9daed2c0-c120-4305-94a7-3022f982ec2d tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:24:27.463453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9daed2c0-c120-4305-94a7-3022f982ec2d tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.902890 Jul 28 09:24:27.464049 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Jul 28 09:24:26 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 905 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:24:27.705855 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8ef53af7-12c3-47ab-9654-42080fc73587 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Action: 'create', calling method: .version_select at 0x7f16d2469dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-243686232", "metadata": {"Type": "work"}}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:27.709240 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8ef53af7-12c3-47ab-9654-42080fc73587 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:24:27.710564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8ef53af7-12c3-47ab-9654-42080fc73587 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.239671 Jul 28 09:24:27.711682 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Jul 28 09:24:27 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:24:27.720314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d281511c-9a34-462e-9e6a-5c9b263a6f15 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Action: 'create', calling method: .version_select at 0x7f16d242dd30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2054246785", "metadata": {"Type": "work"}}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:27.721932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d281511c-9a34-462e-9e6a-5c9b263a6f15 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:24:27.722963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d281511c-9a34-462e-9e6a-5c9b263a6f15 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006380 Jul 28 09:24:27.724946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Jul 28 09:24:27 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:24:27.734269 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-80e0f866-ed66-44c8-af4b-79b7223ce178 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Calling method '.version_select at 0x7f16d239b9d0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:28.414630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-80e0f866-ed66-44c8-af4b-79b7223ce178 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] HTTP exception thrown: Volume tempest-invalid-1939235833 could not be found. Jul 28 09:24:28.415390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-80e0f866-ed66-44c8-af4b-79b7223ce178 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Returning 404 to user: Volume tempest-invalid-1939235833 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:24:28.416319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-80e0f866-ed66-44c8-af4b-79b7223ce178 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1939235833" status: 404 len: 99 microversion: 2.1 time: 0.685959 Jul 28 09:24:28.417157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1218 bytes} [Wed Jul 28 09:24:27 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1939235833 => generated 99 bytes in 687 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 09:24:28.426604 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1ab0613a-0dce-4ea1-a9f0-bdb6ef1480c8 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003609 Jul 28 09:24:28.427268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1140 bytes} [Wed Jul 28 09:24:28 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 09:24:28.436562 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-da511526-ee0f-44e3-a548-0d1017b6d8e8 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003905 Jul 28 09:24:28.438968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1137 bytes} [Wed Jul 28 09:24:28 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 09:24:28.449171 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a699f7e2-4459-48ee-8c82-162307ca2401 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Calling method '.version_select at 0x7f16d242d940>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:28.874517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-a699f7e2-4459-48ee-8c82-162307ca2401 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] HTTP exception thrown: Volume 1fccd378-13b9-4261-9ff4-500316243564 could not be found. Jul 28 09:24:28.876163 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a699f7e2-4459-48ee-8c82-162307ca2401 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Returning 404 to user: Volume 1fccd378-13b9-4261-9ff4-500316243564 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:24:28.877329 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a699f7e2-4459-48ee-8c82-162307ca2401 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/1fccd378-13b9-4261-9ff4-500316243564" status: 404 len: 109 microversion: 2.1 time: 0.432491 Jul 28 09:24:28.882398 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Jul 28 09:24:28 2021] DELETE /compute/v2.1/os-volumes/1fccd378-13b9-4261-9ff4-500316243564 => generated 109 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:24:28.887924 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ebc2df57-7c7c-480a-b8e3-2f576a8d6590 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Calling method '.version_select at 0x7f16d2287160>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:28.950777 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-ebc2df57-7c7c-480a-b8e3-2f576a8d6590 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] HTTP exception thrown: Volume 83cc6f4f-7c47-4e45-95fd-1a8936350367 could not be found. Jul 28 09:24:28.952141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ebc2df57-7c7c-480a-b8e3-2f576a8d6590 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] Returning 404 to user: Volume 83cc6f4f-7c47-4e45-95fd-1a8936350367 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:24:28.953107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ebc2df57-7c7c-480a-b8e3-2f576a8d6590 tempest-VolumesNegativeTest-873409085 tempest-VolumesNegativeTest-873409085-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/83cc6f4f-7c47-4e45-95fd-1a8936350367" status: 404 len: 109 microversion: 2.1 time: 0.069041 Jul 28 09:24:28.953644 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:24:28 2021] GET /compute/v2.1/os-volumes/83cc6f4f-7c47-4e45-95fd-1a8936350367 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:24:29.632504 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1209095042", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "3463c92e-9592-4a5e-be73-c0318bba2428"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:29.783697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] validate_networks() for [('3463c92e-9592-4a5e-be73-c0318bba2428', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:24:31.438793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:24:31.439402 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:24:31.439718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:24:31.440356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:24:31.440956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:24:31.469671 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:31.470107 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:31.470961 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:31.471405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:31.509241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:31.517452 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for user 56058a59ffca404ba8121aae6e09ce3b and project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:31.531681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:24:31.534677 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:24:31.635768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-152589a1-9a79-485d-a221-fae63fa51183 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.295861 Jul 28 09:24:31.636833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 5/9] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:24:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:24:31.652703 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2cca62fc-a550-41da-9f54-655c1c5dc2ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:31.653500 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2cca62fc-a550-41da-9f54-655c1c5dc2ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:32.088598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2cca62fc-a550-41da-9f54-655c1c5dc2ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:32.113488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2cca62fc-a550-41da-9f54-655c1c5dc2ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1218 microversion: 2.1 time: 0.464716 Jul 28 09:24:32.124133 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 5/10] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:31 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1218 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:33.131917 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4ba1d2ed-1b0f-46b9-8e81-c47aee2964a7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:33.133078 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4ba1d2ed-1b0f-46b9-8e81-c47aee2964a7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:33.350504 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4ba1d2ed-1b0f-46b9-8e81-c47aee2964a7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:33.377523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4ba1d2ed-1b0f-46b9-8e81-c47aee2964a7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1218 microversion: 2.1 time: 0.250654 Jul 28 09:24:33.380738 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:33 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1218 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:34.209906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-343275327", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "b1b43698-b9d6-4b16-bb1c-3b1165b061e7"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:34.399592 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:34.401036 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:34.416633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:34.421553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:34.422398 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:34.422840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:34.446392 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] validate_networks() for [('b1b43698-b9d6-4b16-bb1c-3b1165b061e7', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:24:34.906794 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:34.926795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-cba4fc4a-fe52-48e8-a194-c0f9fc49fb13 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1222 microversion: 2.1 time: 0.533236 Jul 28 09:24:34.929435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:34 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1222 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:24:35.943292 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:35.945563 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:35.952456 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:35.954018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:35.956993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:35.960842 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:36.194806 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:36.203532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b7abd70a-e091-4a65-a761-303015cba238 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1222 microversion: 2.1 time: 0.264482 Jul 28 09:24:36.206017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:35 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1222 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:24:37.167541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:24:37.168020 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:24:37.168464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:24:37.169879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:24:37.170470 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:24:37.210930 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:37.211732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:37.212756 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:37.213549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:37.223050 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:37.224408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:37.238033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:37.240836 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:37.243552 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:37.262418 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:37.330896 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Getting quotas for project 9e465e5255d9401caf2f0f22d0b6e7c7. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:37.356038 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Getting quotas for user ce47c86afac940bda659ec082e075445 and project 9e465e5255d9401caf2f0f22d0b6e7c7. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:37.392935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:24:37.406491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:24:37.637021 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d0912b9a-5b82-44ff-ac1e-bb79c5a4ef71 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.931747 Jul 28 09:24:37.637900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 6/14] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:24:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 3933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:24:37.651377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7bdd4e6c-ab47-45c2-96ed-dfcbfb1899ac tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:37.652790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7bdd4e6c-ab47-45c2-96ed-dfcbfb1899ac tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:37.664419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:37.675709 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5153508f-36bc-49d9-8fd1-0ae57e2d4567 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1270 microversion: 2.1 time: 0.457064 Jul 28 09:24:37.679259 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 9/15] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:37 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1270 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:37.757978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7bdd4e6c-ab47-45c2-96ed-dfcbfb1899ac tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:37.768183 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7bdd4e6c-ab47-45c2-96ed-dfcbfb1899ac tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1214 microversion: 2.1 time: 0.123634 Jul 28 09:24:37.771670 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 7/16] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:37 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:38.695798 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:38.696799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:38.710811 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:38.712082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:38.718152 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:38.720783 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:38.788750 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b0eab9f5-5f25-44a9-a4a7-9370db8175eb tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:38.790397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b0eab9f5-5f25-44a9-a4a7-9370db8175eb tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:39.769461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b0eab9f5-5f25-44a9-a4a7-9370db8175eb tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:39.779404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b0eab9f5-5f25-44a9-a4a7-9370db8175eb tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1214 microversion: 2.1 time: 0.994951 Jul 28 09:24:39.780584 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:38 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1214 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:39.845283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:39.854237 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-56b780e2-4280-4f8e-95e5-a5305f689557 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1276 microversion: 2.1 time: 1.163150 Jul 28 09:24:39.854827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:38 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1276 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:40.797224 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:40.798560 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:40.835544 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:40.838687 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:40.843493 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:40.844318 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:40.870773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:40.871400 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:40.883483 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:40.890754 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:40.904841 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:40.905339 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:41.393727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:41.401380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:41.416732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7a4378e7-b39c-4264-88e2-a154bd9363a4 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1274 microversion: 2.1 time: 0.623471 Jul 28 09:24:41.420034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:40 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1274 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:41.421590 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0f4dce7d-d205-4981-a0c6-001c2b7bcddd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1276 microversion: 2.1 time: 0.548145 Jul 28 09:24:41.436607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:40 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1276 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:24:42.439601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:42.440449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:42.441160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:42.441603 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:42.451288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:42.451783 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:42.452588 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:42.453800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:42.454634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:42.455936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:42.456646 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:42.457987 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:43.194220 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:43.207426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-05f0061d-70ff-418a-bb92-c33f576dfaaf tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1272 microversion: 2.1 time: 0.771341 Jul 28 09:24:43.229422 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 10/21] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:42 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1272 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:44.225787 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:44.226688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:44.249452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:44.249915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:44.250715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:44.251152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:44.625269 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:44.629199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:44.641982 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9206b6e3-936d-47db-8251-56d13f0e6b41 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 2.205826 Jul 28 09:24:44.647123 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2d32b885-63eb-4cf8-8398-9bc7e6ec0674 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1272 microversion: 2.1 time: 0.425844 Jul 28 09:24:44.654113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 12/22] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:42 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:44.656698 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:44 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1272 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:24:45.432957 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6b8db16d-58f6-4443-9c9f-8fbe1773fd8a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'create', calling method: .version_select at 0x7f16d18ec700>, body: {"keypair": {"name": "tempest-keypair-673955249"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:45.513245 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-6b8db16d-58f6-4443-9c9f-8fbe1773fd8a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:45.522846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-6b8db16d-58f6-4443-9c9f-8fbe1773fd8a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for user 4ccc60eb94ea47cc9dfa5f5240c16263 and project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:45.670137 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:45.671822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:45.686029 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:45.689602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:45.693419 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:45.695384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:46.089724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:46.099809 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bad359a3-1a9d-46cc-b268-703e5f831cc7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.433384 Jul 28 09:24:46.105090 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:45 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:24:46.116716 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:46.119487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:46.136991 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:46.139895 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:46.143051 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:46.145409 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:46.209800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-6b8db16d-58f6-4443-9c9f-8fbe1773fd8a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:46.222178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-6b8db16d-58f6-4443-9c9f-8fbe1773fd8a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for user 4ccc60eb94ea47cc9dfa5f5240c16263 and project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:46.255345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6b8db16d-58f6-4443-9c9f-8fbe1773fd8a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.199028 Jul 28 09:24:46.256762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 13/25] 10.222.0.23 () {62 vars in 1199 bytes} [Wed Jul 28 09:24:45 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1202 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:24:46.337547 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:46.347817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2fb9bd04-f0c0-4f75-a0b4-e259e96bd842 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1272 microversion: 2.1 time: 0.240863 Jul 28 09:24:46.349184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:46 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:47.154712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f5b2c89b-5704-4810-b8c2-eb5a48bd7571 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: .version_select at 0x7f16d1896820>, body: {"keypair": {"name": "tempest-keypair-1701143215"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:47.200803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-f5b2c89b-5704-4810-b8c2-eb5a48bd7571 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:47.208971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-f5b2c89b-5704-4810-b8c2-eb5a48bd7571 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for user c6defae8d5f64f56ac3c5f3d3abd9aff and project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:47.557134 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-f5b2c89b-5704-4810-b8c2-eb5a48bd7571 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:47.572281 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-f5b2c89b-5704-4810-b8c2-eb5a48bd7571 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for user c6defae8d5f64f56ac3c5f3d3abd9aff and project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:47.622619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1506898564", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc5fa390-0a22-474b-ac35-e54c73e4ebd9"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:47.643030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f5b2c89b-5704-4810-b8c2-eb5a48bd7571 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.382580 Jul 28 09:24:47.651086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 14/27] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jul 28 09:24:46 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:47.680103 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:47.683824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:47.710035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:47.712060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:47.716614 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:47.718385 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:47.855069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] validate_networks() for [('bc5fa390-0a22-474b-ac35-e54c73e4ebd9', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:24:48.891200 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:48.901783 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-942c94a0-6162-4f10-8a53-639d323fd4ba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 1.243439 Jul 28 09:24:48.907233 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 15/28] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:47 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:48.924408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:48.926036 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:48.946808 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:48.949559 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:48.950503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:48.954954 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:50.623461 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:50.637104 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-16a2b554-aeb3-4a28-90ee-bdcac16caf7f tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 1.725077 Jul 28 09:24:50.649522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 16/29] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:48 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:50.661933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:50.679008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:50.703138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:50.705852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:50.706684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:50.707136 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:51.880209 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:51.891591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f7a9fa5e-1ed7-40d0-9900-b8ae87e3ad59 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 1.234788 Jul 28 09:24:51.893465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 17/30] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:50 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:51.917579 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:51.924265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:51.963929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:51.964808 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:51.965620 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:51.969485 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:52.079484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:24:52.080002 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:24:52.080397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:24:52.080806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:24:52.081215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:24:52.121519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:52.121981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:52.122782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:52.123226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:52.214856 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Getting quotas for project cdd4025f7c74471e81aa73079f97a769. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:52.252340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Getting quotas for user acb53585b04741c98fff2fcf6d697145 and project cdd4025f7c74471e81aa73079f97a769. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:52.305598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:24:52.308578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:24:52.439019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e76b35b1-5a5f-48a6-9bba-67cf8c4b80d5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.086973 Jul 28 09:24:52.440582 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 14/31] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:24:46 2021] POST /compute/v2.1/servers => generated 383 bytes in 6091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:24:52.455719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e947366a-d82d-4c0b-9487-9d695c84c2a9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:52.457142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e947366a-d82d-4c0b-9487-9d695c84c2a9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:52.723491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e947366a-d82d-4c0b-9487-9d695c84c2a9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:52.742898 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e947366a-d82d-4c0b-9487-9d695c84c2a9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1222 microversion: 2.1 time: 0.294994 Jul 28 09:24:52.755863 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 15/32] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:52 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1222 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:52.913697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:52.914148 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:52.928729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:52.934872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:52.938796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:52.940129 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:53.674235 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:53.688419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2e1616e0-c81b-4db3-82e9-b07ed43e36b2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 1.784775 Jul 28 09:24:53.695892 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:51 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:53.702077 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-761789073", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc5fa390-0a22-474b-ac35-e54c73e4ebd9"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:53.825348 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] validate_networks() for [('bc5fa390-0a22-474b-ac35-e54c73e4ebd9', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:24:53.835405 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:53.844319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-89d3c2e0-377c-44cf-8dcc-00eaeefa19ac tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.937416 Jul 28 09:24:53.856711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 16/34] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:52 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:24:54.151065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-657d1657-3b32-4e6b-834c-3094050be723 req-f0836775-24b3-4a22-bd6d-9f9a86f294de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1287df-cb69-4058-b6ed-b2156f10ea45", "tag": "d71e8fb8-deed-4e7a-ad68-64fbaee0e441"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:54.153766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:24:54.153766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:24:54.202099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-657d1657-3b32-4e6b-834c-3094050be723 req-f0836775-24b3-4a22-bd6d-9f9a86f294de service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:54.210659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-657d1657-3b32-4e6b-834c-3094050be723 req-f0836775-24b3-4a22-bd6d-9f9a86f294de service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:54.250711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-657d1657-3b32-4e6b-834c-3094050be723 req-f0836775-24b3-4a22-bd6d-9f9a86f294de service nova] Creating event network-changed:d71e8fb8-deed-4e7a-ad68-64fbaee0e441 for instance 6e1287df-cb69-4058-b6ed-b2156f10ea45 on hv-cinder-80266 Jul 28 09:24:54.276540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-657d1657-3b32-4e6b-834c-3094050be723 req-f0836775-24b3-4a22-bd6d-9f9a86f294de service nova] Acquired lock "compute-rpcapi-router" {{(pid=107293) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 28 09:24:54.278071 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:54.278464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:54.279256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:54.279723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:54.322875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.compute.rpcapi [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 28 09:24:54.328056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] Releasing lock "compute-rpcapi-router" {{(pid=107293) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 28 09:24:54.360813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0b4e2d9c-cc7a-4cb5-a52a-bb9f60e1130f None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502518 Jul 28 09:24:54.365578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:24:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:24:54.643641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-732e18f5-1f6b-4f39-802c-ce17d16812f0 req-c3253637-a77f-47dd-bb54-d068d7be4440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3553763b-4ea7-46c3-a243-3e7217b9f319", "tag": "eca2dda2-dd14-4098-a22d-67e6250c6eb4"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:54.646426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:24:54.646426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:24:54.656693 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-732e18f5-1f6b-4f39-802c-ce17d16812f0 req-c3253637-a77f-47dd-bb54-d068d7be4440 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:54.664799 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-732e18f5-1f6b-4f39-802c-ce17d16812f0 req-c3253637-a77f-47dd-bb54-d068d7be4440 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:54.706359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-732e18f5-1f6b-4f39-802c-ce17d16812f0 req-c3253637-a77f-47dd-bb54-d068d7be4440 service nova] Creating event network-changed:eca2dda2-dd14-4098-a22d-67e6250c6eb4 for instance 3553763b-4ea7-46c3-a243-3e7217b9f319 on hv-cinder-80266 Jul 28 09:24:54.715618 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-732e18f5-1f6b-4f39-802c-ce17d16812f0 req-c3253637-a77f-47dd-bb54-d068d7be4440 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348489 Jul 28 09:24:54.716991 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 18/36] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:24:54.722126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:54.723066 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:54.731728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:54.732250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:54.734079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:54.734873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:55.541997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:55.551143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-287507a9-f1b3-4077-bfc1-31b82a50040a tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.832721 Jul 28 09:24:55.556420 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 19/37] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:54 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:55.562813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:55.566948 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:55.580345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:55.586082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:55.587255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:55.590282 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:56.406787 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:56.417111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8e9217f7-beb6-4932-ad0f-8077bc95c3c4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.857411 Jul 28 09:24:56.418330 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:55 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:56.425676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1933274381", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39e9cde6-0d01-4242-a6ed-06857cf13960"}], "security_groups": [{"name": "tempest-securitygroup--694601111"}], "key_name": "tempest-keypair-1701143215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:56.601199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:24:56.601777 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:24:56.602088 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:24:56.602496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:24:56.603084 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:24:56.613474 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:56.615057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:56.616270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:56.617584 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:56.649739 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Getting quotas for project cdd4025f7c74471e81aa73079f97a769. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:56.654514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Getting quotas for user acb53585b04741c98fff2fcf6d697145 and project cdd4025f7c74471e81aa73079f97a769. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:56.674414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:24:56.678356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:24:56.751385 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e98531c8-20f3-434b-8695-56ae1a65495d tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.054101 Jul 28 09:24:56.758100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:24:53 2021] POST /compute/v2.1/servers => generated 383 bytes in 3061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:24:56.765692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:56.766627 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:56.774891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:56.776000 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:56.777029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:56.778056 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:56.970842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] validate_networks() for [('39e9cde6-0d01-4242-a6ed-06857cf13960', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:24:57.753816 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:57.762068 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-600e58a7-edff-4144-9219-ad1902605881 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 1.001800 Jul 28 09:24:57.771872 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:56 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:57.776925 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:57.778073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:57.784535 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:57.785655 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:57.786582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:57.787168 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:57.918968 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:57.942336 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8f3dc31a-e42d-44f3-a371-f5160b2b3ebc tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1281 microversion: 2.1 time: 0.168252 Jul 28 09:24:57.942971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:57 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:57.955974 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:57.959436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:57.974754 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:57.975214 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:57.977553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:57.978007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:58.475913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:58.491403 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a750bd89-b5e9-454d-82b3-f2fc8aad56aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.543462 Jul 28 09:24:58.492188 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:57 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:58.513834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-448170159", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59c4a637-5ed0-4b6e-a037-96ec97ce270f"}], "security_groups": [{"name": "tempest-securitygroup--1453730725"}], "key_name": "tempest-keypair-673955249", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:24:58.816377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] validate_networks() for [('59c4a637-5ed0-4b6e-a037-96ec97ce270f', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:24:58.895792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:24:58.896329 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:24:58.896850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:24:58.897331 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:24:58.897814 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:24:58.915798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:58.916734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:58.917701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:58.918285 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:58.956546 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:24:58.968782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for user c6defae8d5f64f56ac3c5f3d3abd9aff and project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:24:59.000540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:24:59.002897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:24:59.090781 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-56fe10ab-4715-469f-bdd5-5979f485b33a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.671169 Jul 28 09:24:59.096429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 21/43] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:24:56 2021] POST /compute/v2.1/servers => generated 401 bytes in 2677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:24:59.117939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:59.118850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:59.125034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:59.125494 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:59.126359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:59.126953 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:59.552126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:59.566243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7ab99d91-325f-4536-95a8-00237885e645 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.468379 Jul 28 09:24:59.576248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 22/44] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:59 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:24:59.581168 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:24:59.581789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:24:59.599322 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:59.604241 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:59.605303 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:24:59.609055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:24:59.990111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:24:59.999312 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b6775289-b39c-4753-adfa-326e56c24367 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.421678 Jul 28 09:25:00.014205 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 23/45] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:24:59 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:00.019064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:00.026087 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:00.039289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.041119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.042415 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.042978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.212346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:00.219769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-feb48279-1f96-452e-b5a1-7aee9d3796f8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1234 microversion: 2.1 time: 0.204274 Jul 28 09:25:00.220363 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 24/46] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:00 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1234 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:00.237738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:00.244056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:00.253444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:25:00.253977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:25:00.255921 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:25:00.256496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:25:00.257219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:25:00.282946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.286562 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.288408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.288880 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.289690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.291824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.293432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.295147 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.354428 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:25:00.366880 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for user 4ccc60eb94ea47cc9dfa5f5240c16263 and project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:25:00.399497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:25:00.401960 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:25:00.503109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3b3809a6-beec-4067-8069-53b02befc6a3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.008927 Jul 28 09:25:00.504748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 23/47] 10.222.0.23 () {62 vars in 1188 bytes} [Wed Jul 28 09:24:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 09:25:00.514435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-20839178-b66c-4f3d-8d0f-f87131a0bf45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:00.515782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-20839178-b66c-4f3d-8d0f-f87131a0bf45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:00.723557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-20839178-b66c-4f3d-8d0f-f87131a0bf45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:00.734325 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-20839178-b66c-4f3d-8d0f-f87131a0bf45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:00.740107 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-20839178-b66c-4f3d-8d0f-f87131a0bf45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:00.742436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-20839178-b66c-4f3d-8d0f-f87131a0bf45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1280 microversion: 2.20 time: 0.231868 Jul 28 09:25:00.747695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 24/48] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:00 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:00.767392 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:00.769961 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:00.776627 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.777157 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:00.778496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:00.779016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:01.133215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:01.142046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-682d9d42-d7fc-4130-ab31-554e737b3539 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.909295 Jul 28 09:25:01.145525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 25/49] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:00 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:01.150238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-5835190a-93ea-4579-b88a-19ed1f15f45b req-3bcc142c-b57b-499f-a092-72dae1bb3a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722bacfd-c01b-427f-a5db-de2581b3dc2e", "tag": "2b4fdddf-03d6-4edc-b888-724b64f54c3b"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:01.160164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:01.160164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:01.177417 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5835190a-93ea-4579-b88a-19ed1f15f45b req-3bcc142c-b57b-499f-a092-72dae1bb3a8b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:01.177936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5835190a-93ea-4579-b88a-19ed1f15f45b req-3bcc142c-b57b-499f-a092-72dae1bb3a8b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:01.209971 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-5835190a-93ea-4579-b88a-19ed1f15f45b req-3bcc142c-b57b-499f-a092-72dae1bb3a8b service nova] Creating event network-changed:2b4fdddf-03d6-4edc-b888-724b64f54c3b for instance 722bacfd-c01b-427f-a5db-de2581b3dc2e on hv-cinder-80266 Jul 28 09:25:01.220185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-5835190a-93ea-4579-b88a-19ed1f15f45b req-3bcc142c-b57b-499f-a092-72dae1bb3a8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073206 Jul 28 09:25:01.222541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 26/50] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:01.233626 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-5c44ebfe-5147-4c40-b72b-c968b99b49f3 req-f3c2c599-667f-45d4-9489-4996ef6ed758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67", "tag": "516a84f0-5846-45f0-8ffc-f11a2e8eec67"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:01.244792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:01.244792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:01.262668 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5c44ebfe-5147-4c40-b72b-c968b99b49f3 req-f3c2c599-667f-45d4-9489-4996ef6ed758 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:01.263469 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5c44ebfe-5147-4c40-b72b-c968b99b49f3 req-f3c2c599-667f-45d4-9489-4996ef6ed758 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:01.278294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-5c44ebfe-5147-4c40-b72b-c968b99b49f3 req-f3c2c599-667f-45d4-9489-4996ef6ed758 service nova] Creating event network-changed:516a84f0-5846-45f0-8ffc-f11a2e8eec67 for instance 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 on hv-cinder-80266 Jul 28 09:25:01.298947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-5c44ebfe-5147-4c40-b72b-c968b99b49f3 req-f3c2c599-667f-45d4-9489-4996ef6ed758 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072346 Jul 28 09:25:01.302595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 27/51] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:01.314688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:01.316031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:01.334360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:01.334829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:01.335745 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:01.336391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:01.735058 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:01.746097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-436e6680-87d4-4722-a650-0784802ff666 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.994965 Jul 28 09:25:01.748107 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 25/52] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:00 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:01.784077 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:01.785178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:01.809797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:01.811232 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:01.813380 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:01.814546 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:02.034217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:02.042271 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:02.049908 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-750d198b-fe1d-41a3-a6d1-c4960fca6bae tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.741275 Jul 28 09:25:02.051728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 28/53] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:01 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:02.060830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ec5fe060-ed82-4c6f-8a78-57db8dda08e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1296 microversion: 2.1 time: 0.284456 Jul 28 09:25:02.061434 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 26/54] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:01 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1296 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:02.080145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:02.081145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:02.093566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:02.097093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:02.098657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:02.099127 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:02.172553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:02.173344 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:02.191156 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:02.199866 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:02.201985 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:02.202582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:02.367755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:02.383837 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:02.388113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:02.393211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b7d9b9be-7324-4991-a29f-9c7903d42684 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1350 microversion: 2.20 time: 0.338470 Jul 28 09:25:02.396330 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 29/55] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:02 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1350 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:02.618649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:02.630024 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1f8ed3e7-30ca-44f8-8b99-b7d2b2875b5b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.472401 Jul 28 09:25:02.632116 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 27/56] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:02 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:02.772699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:02.773636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:02.787987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:02.789239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:02.790826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:02.795739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.071891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:03.074288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:03.086710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.091791 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.099697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.100715 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.246968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:03.256141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-eb2b8377-0668-423e-85b7-57eaebfd3b21 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.496142 Jul 28 09:25:03.259918 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 30/57] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:02 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:03.270754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:03.271403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:03.303359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.303748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.304609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.305026 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.449547 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:03.460879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0c4148c5-c8ea-48d5-b19b-68e5d709379b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1296 microversion: 2.1 time: 0.199914 Jul 28 09:25:03.462919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 31/58] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:03 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1296 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:03.468172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:03.469179 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:03.480263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.483245 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.484255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.484811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.736900 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:03.748000 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9b081b8b-8890-4446-a797-3e9592d5e565 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.681755 Jul 28 09:25:03.749784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 28/59] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:03 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:03.875150 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-2d3e61a0-2c37-4fa2-9fcd-2f40d3bc237f req-af633bce-beb5-4b0b-b4dd-a21950db352b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1287df-cb69-4058-b6ed-b2156f10ea45", "name": "network-vif-plugged", "status": "completed", "tag": "d71e8fb8-deed-4e7a-ad68-64fbaee0e441"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:03.878195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:03.878195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:25:03.894524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:03.903863 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-2d3e61a0-2c37-4fa2-9fcd-2f40d3bc237f req-af633bce-beb5-4b0b-b4dd-a21950db352b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.904319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-2d3e61a0-2c37-4fa2-9fcd-2f40d3bc237f req-af633bce-beb5-4b0b-b4dd-a21950db352b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.907139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:03.910752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:03.912158 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d0152676-0c74-4d3e-b851-1f0ae3192636 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.448045 Jul 28 09:25:03.914523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 32/60] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:03 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:03.919353 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:03.920348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:03.933533 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.934346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.935379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.936085 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.971789 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-2d3e61a0-2c37-4fa2-9fcd-2f40d3bc237f req-af633bce-beb5-4b0b-b4dd-a21950db352b service nova] Creating event network-vif-plugged:d71e8fb8-deed-4e7a-ad68-64fbaee0e441 for instance 6e1287df-cb69-4058-b6ed-b2156f10ea45 on hv-cinder-80266 Jul 28 09:25:03.972302 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-2d3e61a0-2c37-4fa2-9fcd-2f40d3bc237f req-af633bce-beb5-4b0b-b4dd-a21950db352b service nova] Acquired lock "compute-rpcapi-router" {{(pid=107292) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 28 09:25:03.980640 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.981296 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:03.982121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:03.982558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.025311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.compute.rpcapi [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 28 09:25:04.026570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] Releasing lock "compute-rpcapi-router" {{(pid=107292) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 28 09:25:04.073663 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-55189cf1-4617-43a9-9576-8dca1a1087ca None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.322023 Jul 28 09:25:04.075209 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 29/61] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:04.128732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:04.140385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d9dfab39-5f37-4994-8f71-d3224bc28bba tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.224635 Jul 28 09:25:04.141793 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 33/62] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:03 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:04.274552 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:04.275081 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:04.281723 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.282437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.283451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.284215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.313268 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-39d2b2b5-7a40-4e32-8ea8-f8b9b015188f req-edf96d7f-fa57-4fc8-9a62-9a55d8b329f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:04.315099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:04.315099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:04.334603 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-39d2b2b5-7a40-4e32-8ea8-f8b9b015188f req-edf96d7f-fa57-4fc8-9a62-9a55d8b329f5 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.335080 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-39d2b2b5-7a40-4e32-8ea8-f8b9b015188f req-edf96d7f-fa57-4fc8-9a62-9a55d8b329f5 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.358028 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-39d2b2b5-7a40-4e32-8ea8-f8b9b015188f req-edf96d7f-fa57-4fc8-9a62-9a55d8b329f5 service nova] Creating event network-changed:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:25:04.363612 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-39d2b2b5-7a40-4e32-8ea8-f8b9b015188f req-edf96d7f-fa57-4fc8-9a62-9a55d8b329f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053969 Jul 28 09:25:04.364571 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 34/63] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:04.473517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:04.479509 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:04.480610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:04.484737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-751057b1-d8d6-4796-993b-f09df79d3315 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.214880 Jul 28 09:25:04.487694 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.488311 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.489427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.490134 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.491635 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 30/64] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:04 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:04.628875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:04.637002 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5835ce7c-2802-4fec-94a9-060493ec278d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.161706 Jul 28 09:25:04.637640 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 35/65] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:04 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:04.766239 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:04.766879 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:04.773087 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.773534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.774293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.774731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.893720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:04.901333 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-856e5293-1eb9-4096-a986-66f915a90d2b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.138767 Jul 28 09:25:04.901895 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 31/66] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:04 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:04.932576 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:04.933194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:04.939037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.939480 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:04.940283 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:04.940716 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.060220 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:05.068141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:05.069689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:05.070779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e25d1ece-1150-4db7-ad78-b2bc4d32ca7d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.141907 Jul 28 09:25:05.071317 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 36/67] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:04 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:25:05.157221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:05.157838 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:05.164161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.164608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.165364 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.165793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.289215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:05.296415 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-496bbd98-c03c-47cd-a965-394514703964 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.142785 Jul 28 09:25:05.296971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 32/68] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:05 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:05.506230 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:05.506879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:05.512866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.513347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.514117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.514703 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.636525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:05.644116 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9f06b195-d952-4100-938f-ae55ab2d308e tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.141487 Jul 28 09:25:05.653979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 37/69] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:05 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:05.654148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:05.654522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:05.661447 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.662051 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.663023 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.663538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.790768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:05.798225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dd38e48b-5d83-4757-9bf1-d3cde377e52c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.148405 Jul 28 09:25:05.798784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 33/70] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:05 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:05.918951 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:05.919491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:05.925214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.925688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:05.927026 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:05.927501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.056170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:06.063513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-17b4c464-004d-4645-9ea7-24eec9a896a1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.148295 Jul 28 09:25:06.064101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 38/71] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:05 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:06.088516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:06.089267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:06.089877 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-aefed7a6-6754-47c7-a710-dc1e581abc3c req-f89f0bfb-8e51-4999-839b-3d93bf874137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3553763b-4ea7-46c3-a243-3e7217b9f319", "name": "network-vif-plugged", "status": "completed", "tag": "eca2dda2-dd14-4098-a22d-67e6250c6eb4"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:06.091621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:06.091621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:06.095156 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.095622 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.096401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.096842 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.100043 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-aefed7a6-6754-47c7-a710-dc1e581abc3c req-f89f0bfb-8e51-4999-839b-3d93bf874137 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.100590 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-aefed7a6-6754-47c7-a710-dc1e581abc3c req-f89f0bfb-8e51-4999-839b-3d93bf874137 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.112363 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-aefed7a6-6754-47c7-a710-dc1e581abc3c req-f89f0bfb-8e51-4999-839b-3d93bf874137 service nova] Creating event network-vif-plugged:eca2dda2-dd14-4098-a22d-67e6250c6eb4 for instance 3553763b-4ea7-46c3-a243-3e7217b9f319 on hv-cinder-80266 Jul 28 09:25:06.118359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-aefed7a6-6754-47c7-a710-dc1e581abc3c req-f89f0bfb-8e51-4999-839b-3d93bf874137 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Jul 28 09:25:06.119598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 39/72] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:06.229988 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:06.237647 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:06.239487 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:06.240624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ab3ee0a6-01e6-46ac-8867-02ea99067184 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.156116 Jul 28 09:25:06.241180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 34/73] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:06 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:06.313554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:06.314256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:06.326708 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.327403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.328386 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.328970 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.664238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:06.665553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:06.689569 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.696813 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:06.702278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:06.704141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.202265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:07.214463 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4a6816c0-1420-4583-9895-67227e607842 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.904102 Jul 28 09:25:07.217189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 40/74] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:06 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:07.226697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:07.227618 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:07.236471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:07.237817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.238888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:07.239536 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.307437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:07.316236 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4ac9a084-112c-40c8-a83e-08b8f1694a17 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.658451 Jul 28 09:25:07.318476 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 35/75] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:06 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:07.325237 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:07.326048 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:07.334506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:07.335922 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.337210 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:07.337849 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.631623 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:07.649574 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2ac31aea-e0aa-4428-961f-6ed2c9b34143 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.429929 Jul 28 09:25:07.650777 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 41/76] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:07 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:07.668864 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:07.669795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:07.677764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:07.678482 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.679503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:07.680185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:07.711475 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:07.719463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-43bb27b4-4a3f-438b-a4e6-fd4f5e03aeea tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.399455 Jul 28 09:25:07.732130 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 36/77] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:07 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:08.038466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.047041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.055764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.060587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-72436a13-4c32-456a-b300-92fbe9c4b366 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.408070 Jul 28 09:25:08.061540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 42/78] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:07 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:08.235921 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:08.237923 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:08.247884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-22a749db-ed52-4742-8abb-8d03268f5abb req-ab46f616-22f5-4add-9d36-6534a169a000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93e643c-a780-41fb-9719-43b374afe806", "tag": "07e5d078-45f6-402a-8b20-74f5720941fe"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:08.250319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.250875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:08.250875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:08.251340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.252446 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.253121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.277934 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-22a749db-ed52-4742-8abb-8d03268f5abb req-ab46f616-22f5-4add-9d36-6534a169a000 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.280824 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-22a749db-ed52-4742-8abb-8d03268f5abb req-ab46f616-22f5-4add-9d36-6534a169a000 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.300294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-22a749db-ed52-4742-8abb-8d03268f5abb req-ab46f616-22f5-4add-9d36-6534a169a000 service nova] Creating event network-changed:07e5d078-45f6-402a-8b20-74f5720941fe for instance a93e643c-a780-41fb-9719-43b374afe806 on hv-cinder-80266 Jul 28 09:25:08.307414 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-22a749db-ed52-4742-8abb-8d03268f5abb req-ab46f616-22f5-4add-9d36-6534a169a000 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075036 Jul 28 09:25:08.308354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 43/79] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:08.341277 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:08.344408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:08.357068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.358845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.359900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.362850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.635098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.642710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7534514e-4313-4282-b992-3545406a303c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.411525 Jul 28 09:25:08.645827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 37/80] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:08 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:08.666816 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:08.667564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:08.681478 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.682035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.682902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.683411 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.707077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.717784 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6126be44-f583-4bea-a9f6-b8fe44ae7aec tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.386806 Jul 28 09:25:08.731453 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 44/81] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:08 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:08.742095 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:08.743747 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:08.750374 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.751019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.752014 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.752623 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.921195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.934225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7d928d8b-dbda-4798-b594-058a06026703 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.270737 Jul 28 09:25:08.935433 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 38/82] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:08 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:08.940445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-c1b3f5f1-becb-4350-a77e-906bc858fe2c req-8e094437-be1e-4f2f-9508-7462f007a875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67", "name": "network-vif-plugged", "status": "completed", "tag": "516a84f0-5846-45f0-8ffc-f11a2e8eec67"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:08.942925 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:08.942925 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:25:08.947956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:08.957944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-c1b3f5f1-becb-4350-a77e-906bc858fe2c req-8e094437-be1e-4f2f-9508-7462f007a875 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:08.958264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-c1b3f5f1-becb-4350-a77e-906bc858fe2c req-8e094437-be1e-4f2f-9508-7462f007a875 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:08.961093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2e81a7fe-14f9-49c0-b0c4-fff4189acf09 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.220892 Jul 28 09:25:08.965092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 45/83] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:08 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:08.977117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-c1b3f5f1-becb-4350-a77e-906bc858fe2c req-8e094437-be1e-4f2f-9508-7462f007a875 service nova] Creating event network-vif-plugged:516a84f0-5846-45f0-8ffc-f11a2e8eec67 for instance 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 on hv-cinder-80266 Jul 28 09:25:08.982042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-c1b3f5f1-becb-4350-a77e-906bc858fe2c req-8e094437-be1e-4f2f-9508-7462f007a875 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045260 Jul 28 09:25:08.982580 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 39/84] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:09.079229 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:09.079873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:09.086540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.086989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.087951 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.088534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.249800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:09.258824 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:09.260735 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:09.261832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8b2e4c5a-6b5f-4c7d-9b94-81c0f2de0a7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.186365 Jul 28 09:25:09.274690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 46/85] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:09 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:09.663291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:09.664029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:09.670011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.670453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.671219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.671739 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.741001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:09.742222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:09.753289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.755490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.756382 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.757120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.830453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:09.840914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-011fea81-cb34-4436-86b8-fb5b19887bf4 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.182352 Jul 28 09:25:09.841705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 40/86] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:09 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:09.926477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:09.935635 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-48a91d96-e4ec-4917-85ca-caeda47643f8 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.201273 Jul 28 09:25:09.942717 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 47/87] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:09 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:09.952345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:09.953043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:09.960109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.960704 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.961648 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.962121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.980448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:09.984386 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:09.994724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.995933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:09.996926 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:09.997827 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:10.120875 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:10.128073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fb0ac374-5d84-480c-b75c-8af6832fd465 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.179496 Jul 28 09:25:10.129224 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 41/88] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:09 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:10.175913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:10.183739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7abd1ac6-c29a-490f-8aee-138acf8cbcaa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.206792 Jul 28 09:25:10.194144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 48/89] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:09 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:10.281909 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:10.282587 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:10.289713 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:10.290167 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:10.290997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:10.291491 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:10.428840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:10.436687 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:10.438190 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:10.439746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9df97fb0-7d12-4e05-8b7a-0bb8ac590ad5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.161173 Jul 28 09:25:10.440296 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 42/90] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:10 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:10.858181 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:10.859918 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:10.866844 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:10.867625 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:10.868404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:10.868984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:10.953289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:10.954163 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:10.962086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:10.962536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:10.963519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:10.963977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.070191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.079727 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-15a48228-5b00-46b8-be91-c9a15a344424 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.225181 Jul 28 09:25:11.081133 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 49/91] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:10 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:11.136366 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.143698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-cd79703f-53af-4ffe-9312-38361172723c tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.194710 Jul 28 09:25:11.144297 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 43/92] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:10 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:11.145839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:11.146118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:11.152069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:11.152952 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.154019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:11.154523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.200375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:11.201543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:11.210668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:11.211440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.212388 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:11.213611 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.324459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.331710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e064207d-55a8-4b08-8175-b443f83010c5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.190219 Jul 28 09:25:11.333356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 50/93] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:11 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:11.404471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.414136 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9e9a9e64-07df-4044-932b-c622c55bbb08 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.217313 Jul 28 09:25:11.414705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 44/94] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:11 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:11.461423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:11.462052 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:11.470047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:11.470511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.471461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:11.472070 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:11.764170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.782656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.787724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:11.789542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-de09f1ca-db24-4f1d-87bd-37922f82af62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.334551 Jul 28 09:25:11.800588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 51/95] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:11 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:12.096746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:12.098013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:12.103857 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.104418 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.105254 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.105816 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.161206 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:12.162735 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:12.170518 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.170973 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.171986 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.172737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.598040 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:12.605698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-33a22f01-d4ca-4d29-9cb2-8f33d5b74f08 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1318 microversion: 2.1 time: 0.512416 Jul 28 09:25:12.606199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 45/96] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:12 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1318 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:12.610861 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:12.611928 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:12.619852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.620384 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.621347 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.622097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.647988 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:12.657466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0b0a246e-ab6f-4b9d-b731-1aa3ed59d5cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1314 microversion: 2.1 time: 0.500700 Jul 28 09:25:12.658936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 52/97] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:12 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:12.671804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:12.672816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:12.679555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.680352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.681404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.681932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.923682 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:12.931547 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-03072910-1285-4db4-be1d-32c17aba90ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.324109 Jul 28 09:25:12.939594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:12.943905 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 46/98] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:12 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:12.949246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:12.952098 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-391a4452-54e5-4b41-a901-be92425a66c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1321 microversion: 2.1 time: 0.290720 Jul 28 09:25:12.952483 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:12.954267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 53/99] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:12 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:12.967502 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.968544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:12.969379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:12.969818 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.164243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:13.173042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:13.174553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:13.175813 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ad58bec2-3259-4755-bc14-35383dff90b0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.230544 Jul 28 09:25:13.176381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 47/100] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:12 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:13.556427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-5492cf89-c428-4805-81bc-31c6caec8c9e req-21343d3f-e067-4b45-a533-d85ad2956494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722bacfd-c01b-427f-a5db-de2581b3dc2e", "name": "network-vif-plugged", "status": "completed", "tag": "2b4fdddf-03d6-4edc-b888-724b64f54c3b"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:13.562037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:13.562037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:13.572239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5492cf89-c428-4805-81bc-31c6caec8c9e req-21343d3f-e067-4b45-a533-d85ad2956494 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.573192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5492cf89-c428-4805-81bc-31c6caec8c9e req-21343d3f-e067-4b45-a533-d85ad2956494 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.586029 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-5492cf89-c428-4805-81bc-31c6caec8c9e req-21343d3f-e067-4b45-a533-d85ad2956494 service nova] Creating event network-vif-plugged:2b4fdddf-03d6-4edc-b888-724b64f54c3b for instance 722bacfd-c01b-427f-a5db-de2581b3dc2e on hv-cinder-80266 Jul 28 09:25:13.593290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-5492cf89-c428-4805-81bc-31c6caec8c9e req-21343d3f-e067-4b45-a533-d85ad2956494 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045685 Jul 28 09:25:13.594068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 54/101] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:13.622407 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:13.623094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:13.633591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.634737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.635760 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.636374 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.678870 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:13.680505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:13.689243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.690124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.691779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.694844 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.935972 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:13.943357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6c566f7d-1f8b-4f9e-941d-7b56649deeef tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1507 microversion: 2.1 time: 0.324956 Jul 28 09:25:13.943956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 48/102] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:13 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:13.948633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:13.949244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:13.954804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.957644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.957862 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.958308 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.967258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:13.975917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-12ea9fe1-fc2e-421a-b1c6-36ec669bc067 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1501 microversion: 2.1 time: 0.304387 Jul 28 09:25:13.976971 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 55/103] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:13 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1501 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:13.983259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:13.984044 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:13.991963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.992805 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:13.993969 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:13.994408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.154555 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:14.165038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-19a0f39f-83bc-47c8-b4a9-babd2ef94168 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.219865 Jul 28 09:25:14.165655 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 49/104] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:13 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:14.175238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:14.183768 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-24cbf889-fa7e-499a-a604-4075be727731 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1515 microversion: 2.1 time: 0.204053 Jul 28 09:25:14.184565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 56/105] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:13 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:14.194994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:14.195855 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:14.201914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:14.202582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.203507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:14.203926 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:14.204547 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.204661 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:14.212619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:14.213167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.214117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:14.214546 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.296711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lazy-loading 'flavor' on Instance uuid 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:25:14.391464 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:14.408446 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:14.410418 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:14.412047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-da0b8350-812b-4f94-b5da-0149ee872157 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.221476 Jul 28 09:25:14.412857 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 50/106] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:14 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:14.444666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-534aa2bd-c2b4-4c7c-af43-47f537205f84 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67/action" status: 200 len: 32 microversion: 2.1 time: 0.245502 Jul 28 09:25:14.445504 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 57/107] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:14 2021] POST /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:14.454128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:14.454746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:14.460710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:14.461161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.461920 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:14.462355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:14.584991 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:14.592173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-70cd7ba6-36ca-4a62-a654-d08e3bb42828 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.141860 Jul 28 09:25:14.592740 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 51/108] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:14 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:15.182741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:15.183511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:15.189672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:15.190112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:15.190870 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:15.191336 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:15.317067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:15.324390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7f2a7cd8-dae2-41a7-b627-cc31028d28ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.145787 Jul 28 09:25:15.324949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 58/109] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:15 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:15.430092 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:15.430706 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:15.436460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:15.436842 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:15.437598 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:15.438023 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:15.560355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:15.568941 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:15.570435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:15.571524 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1e3d5e2e-56e9-41a9-aa37-9b9150a0fd94 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.145096 Jul 28 09:25:15.572092 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 52/110] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:15 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:15.609184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:15.609792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:15.615929 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:15.616368 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:15.617129 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:15.617728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:15.740403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:15.747659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-75eb4138-71bc-4b6b-ae5c-bd01664b9e04 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.142263 Jul 28 09:25:15.748223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 59/111] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:15 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:16.341792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:16.342406 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:16.348122 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:16.348572 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:16.349349 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:16.349787 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:16.479856 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:16.488235 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a1c2869a-43b9-4cf2-9964-82f16979677b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.150055 Jul 28 09:25:16.489219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 53/112] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:16 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:16.589062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:16.589671 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:16.596420 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:16.596862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:16.597830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:16.598257 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:16.718008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:16.726054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:16.727558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:16.728666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1fb5226f-3c6c-4c2d-b81d-d856c4319384 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.143633 Jul 28 09:25:16.729222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 60/113] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:16 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:16.764954 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:16.765589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:16.771492 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:16.771971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:16.772727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:16.773155 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:16.896480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:16.904125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e6d2d2db-9f0d-487e-989a-8a647bc341c1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.142769 Jul 28 09:25:16.904697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 54/114] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:16 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:17.505119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:17.505786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:17.513202 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:17.513650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:17.515133 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:17.515608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:17.724622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:17.732322 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8bb49ddc-3a4a-4767-aa2b-87d8ba10763b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.230952 Jul 28 09:25:17.732984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 61/115] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:17 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:17.747342 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:17.749173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:17.755336 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:17.755770 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:17.756561 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:17.757039 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:17.896249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:17.905671 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:17.907327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:17.908698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-baa8e438-f797-4668-b6c3-d96a0bc4b236 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.166128 Jul 28 09:25:17.909303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 55/116] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:17 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:25:17.921948 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:17.922651 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:17.929109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:17.929543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:17.930312 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:17.930742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:18.078813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:18.090227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3eda49a2-5691-4da7-b8a3-9a0427541cb4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.171817 Jul 28 09:25:18.100459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 62/117] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:17 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:18.549662 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "655af95f-52d2-4191-b3a7-d37edf0ab4da"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:18.551391 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:18.559602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:18.560315 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:18.561191 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:18.561682 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:18.629831 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52a5f0a4-befd-4ea7-8568-b1fd35c1d24b"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:18.630971 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:18.636944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:18.637403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:18.638459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:18.638891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:18.933817 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8c71f7fe-5b1e-4b8b-ac30-9413446a6882 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387978 Jul 28 09:25:18.934946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 56/118] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:25:18 2021] POST /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:18.947872 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:18.949436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:18.957496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:18.958316 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:18.959090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:18.959516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:19.026510 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6c2f8423-c4ff-4298-8aef-8246436b83e9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "POST /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400956 Jul 28 09:25:19.028391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 63/119] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:25:18 2021] POST /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:19.040227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:19.041135 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:19.058712 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:19.060118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:19.061380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:19.061839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:19.108445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:19.116668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-120403c5-ee05-4137-964c-c41afbaa843b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.180343 Jul 28 09:25:19.117334 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 57/120] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:18 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:19.123227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:19.123872 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:19.130696 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:19.131333 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:19.132267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:19.133020 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:19.242930 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:19.259856 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:19.264841 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:19.273608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2a3daaa5-c1a7-4348-af94-41dc7dc3a0a2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.236647 Jul 28 09:25:19.274228 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 64/121] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:19 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:19.315285 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:19.324004 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-145fc774-53f6-46a4-a724-6d0b66365773 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.205184 Jul 28 09:25:19.324720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 58/122] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:19 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:19.591853 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-943d14c7-f76e-4b77-bade-b70ae4446cfb req-2d56f3be-a5f2-4382-9cc2-94e221350616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "name": "network-vif-plugged", "status": "completed", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:19.594192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:19.594192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:19.603436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-943d14c7-f76e-4b77-bade-b70ae4446cfb req-2d56f3be-a5f2-4382-9cc2-94e221350616 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:19.604436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-943d14c7-f76e-4b77-bade-b70ae4446cfb req-2d56f3be-a5f2-4382-9cc2-94e221350616 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:19.616664 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-943d14c7-f76e-4b77-bade-b70ae4446cfb req-2d56f3be-a5f2-4382-9cc2-94e221350616 service nova] Creating event network-vif-plugged:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:25:19.622191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-943d14c7-f76e-4b77-bade-b70ae4446cfb req-2d56f3be-a5f2-4382-9cc2-94e221350616 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034339 Jul 28 09:25:19.623424 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 65/123] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:20.141270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:20.141879 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:20.148582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:20.149021 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:20.149773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:20.150196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:20.275903 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:20.283525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-83a42095-e90b-4f4b-a40e-80e3fe5ea7b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.145898 Jul 28 09:25:20.284135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 59/124] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:20 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:20.292748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:20.293566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:20.300990 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:20.301556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:20.302482 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:20.302950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:20.341031 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:20.341643 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:20.348236 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:20.348684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:20.349459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:20.349889 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:20.461445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:20.474942 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:20.476538 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:20.477648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3a951005-9c55-4662-a1ed-ff4dd11daf62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.189131 Jul 28 09:25:20.478214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 66/125] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:20 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:20.520103 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:20.528273 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f0b4c0e4-7ef3-4542-8db1-519be84977ef tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.190703 Jul 28 09:25:20.528833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 60/126] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:20 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:21.300073 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:21.300884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:21.306502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.306951 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.307745 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.308185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.431215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:21.438416 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1a7717ad-d498-464a-91e7-0a21b1436761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.141964 Jul 28 09:25:21.438977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 67/127] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:21 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:21.496356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:21.496960 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:21.503331 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.503830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.504718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.505304 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.546673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:21.547337 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:21.554415 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.554798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.556183 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.556800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.668841 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:21.677768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:21.679497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:21.686426 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-81174727-0c44-481c-9e49-a64143a780d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.193690 Jul 28 09:25:21.687165 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 61/128] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:21 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:21.692465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-cb4e0c2c-ebc7-4879-9599-c9c2e835466a req-a7d162db-6b47-44e2-a727-618a8d596ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93e643c-a780-41fb-9719-43b374afe806", "name": "network-vif-plugged", "status": "completed", "tag": "07e5d078-45f6-402a-8b20-74f5720941fe"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:21.694048 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:21.694048 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:25:21.702618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-cb4e0c2c-ebc7-4879-9599-c9c2e835466a req-a7d162db-6b47-44e2-a727-618a8d596ff5 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:21.703057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-cb4e0c2c-ebc7-4879-9599-c9c2e835466a req-a7d162db-6b47-44e2-a727-618a8d596ff5 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:21.717438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-cb4e0c2c-ebc7-4879-9599-c9c2e835466a req-a7d162db-6b47-44e2-a727-618a8d596ff5 service nova] Creating event network-vif-plugged:07e5d078-45f6-402a-8b20-74f5720941fe for instance a93e643c-a780-41fb-9719-43b374afe806 on hv-cinder-80266 Jul 28 09:25:21.723117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-cb4e0c2c-ebc7-4879-9599-c9c2e835466a req-a7d162db-6b47-44e2-a727-618a8d596ff5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Jul 28 09:25:21.723735 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 62/129] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:21.738407 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:21.745720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a7f5a2b1-9a39-45bc-a191-3d809d021f79 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.203167 Jul 28 09:25:21.746370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 68/130] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:21 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:22.455229 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:22.455939 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:22.462446 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:22.462890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:22.463695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:22.464121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:22.591554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:22.601374 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4bc5e2e4-a3c1-4405-86fe-18ffe5b869e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.150111 Jul 28 09:25:22.610394 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 63/131] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:22 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:22.704842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:22.705453 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:22.712552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:22.712994 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:22.713746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:22.714332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:22.763926 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:22.764546 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:22.770904 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:22.771358 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:22.772164 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:22.772601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:22.904632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:22.913662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:22.915236 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:22.916375 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c7230091-8947-458e-9964-a4c75b465c15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1406 microversion: 2.20 time: 0.215225 Jul 28 09:25:22.917243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 69/132] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:22 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:22.969523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:22.979825 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8bc9f15e-3b8d-4d31-98cf-aa81ce63a075 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.219877 Jul 28 09:25:22.980395 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 64/133] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:22 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:23.618441 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:23.619085 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:23.628959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:23.629340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:23.635234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:23.635730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:23.770247 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:23.778574 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b6bcea12-e3b4-4639-b8e6-f190cfbf85fb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1363 microversion: 2.1 time: 0.163824 Jul 28 09:25:23.779145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 70/134] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:23 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:23.937434 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:23.938167 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:23.946252 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:23.946252 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:23.946713 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:23.947265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:24.000121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:24.001147 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:24.012544 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:24.013546 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:24.014872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:24.015656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:24.304466 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:24.310785 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:24.327514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ef6e9bd5-cf27-48b6-a15f-6378709cecdb tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.332244 Jul 28 09:25:24.337684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:24.340477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 71/135] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:23 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:24.341895 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:24.344725 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-01f2024e-e8be-42c6-8f19-35ebecc83d25 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1599 microversion: 2.20 time: 0.410803 Jul 28 09:25:24.346139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 65/136] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:25:23 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1599 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:25:24.368360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:24.368894 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:24.375279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:24.376031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:24.377459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:24.378683 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:24.478102 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-34a2eb0d-773a-4e42-90b0-0b2e87a4d9b1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113564 Jul 28 09:25:24.478692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 72/137] 10.222.0.23 () {60 vars in 1316 bytes} [Wed Jul 28 09:25:24 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:24.795570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:24.796263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:24.803396 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:24.804997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:24.805993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:24.806430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:25.356524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:25.357702 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:25.376522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:25.377742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:25.379508 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:25.380509 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:25.381101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:25.387324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1d848213-36fa-4b0f-84b9-623cd1630082 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1550 microversion: 2.1 time: 0.595249 Jul 28 09:25:25.391327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 66/138] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:24 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1550 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:25.405509 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:25.406719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:25.414442 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:25.416129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:25.417059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:25.417796 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:25.625297 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e4342875-35c2-4755-9023-7831f081ab0a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223792 Jul 28 09:25:25.626162 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 67/139] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Jul 28 09:25:25 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:25.715655 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:25.723549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-aec95261-6ee3-473c-9ffe-55b14584febd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.370642 Jul 28 09:25:25.726334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 73/140] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:25 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:26.117927 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:26.119201 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:26.120549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-0b2d2b83-e721-43e3-8fcb-2f15fbea61f8 req-14bb9333-0e6b-4425-88c8-b7c73572c828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:26.122954 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:26.122954 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:26.126192 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:26.126892 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:26.127905 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:26.129189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:26.133348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-0b2d2b83-e721-43e3-8fcb-2f15fbea61f8 req-14bb9333-0e6b-4425-88c8-b7c73572c828 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:26.133797 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-0b2d2b83-e721-43e3-8fcb-2f15fbea61f8 req-14bb9333-0e6b-4425-88c8-b7c73572c828 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:26.151502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-0b2d2b83-e721-43e3-8fcb-2f15fbea61f8 req-14bb9333-0e6b-4425-88c8-b7c73572c828 service nova] Creating event network-changed:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:25:26.157089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-0b2d2b83-e721-43e3-8fcb-2f15fbea61f8 req-14bb9333-0e6b-4425-88c8-b7c73572c828 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040367 Jul 28 09:25:26.157947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 74/141] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:26.742981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:26.744376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:26.751436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:26.752159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:26.753684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:26.754660 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:26.938618 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:26.962804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3a34b4fb-00c6-4654-9015-036e34372e49 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.223872 Jul 28 09:25:26.963608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 75/142] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:26 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:27.234645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:27.235755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:27.251013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:27.251873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:27.252919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:27.254345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:29.113578 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-38e73e88-6c46-4b7a-85df-e5efc14a9468 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 2.999838 Jul 28 09:25:29.114450 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 68/143] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:26 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 3002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:29.119460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-edd9fc8a-7281-48c7-a89e-24ac6dff18fa req-e4bec390-42e5-44e9-8e67-627e7dc148fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93e643c-a780-41fb-9719-43b374afe806", "tag": "07e5d078-45f6-402a-8b20-74f5720941fe"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:29.121001 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:29.121001 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:25:29.123634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-044f1de9-c49e-4508-b7aa-4fc432312c5d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 1.893010 Jul 28 09:25:29.126977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 76/144] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:27 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:29.128626 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-edd9fc8a-7281-48c7-a89e-24ac6dff18fa req-e4bec390-42e5-44e9-8e67-627e7dc148fc service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:29.129074 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-edd9fc8a-7281-48c7-a89e-24ac6dff18fa req-e4bec390-42e5-44e9-8e67-627e7dc148fc service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:29.130621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:29.131476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:29.139928 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:29.140493 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:29.140619 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-edd9fc8a-7281-48c7-a89e-24ac6dff18fa req-e4bec390-42e5-44e9-8e67-627e7dc148fc service nova] Creating event network-changed:07e5d078-45f6-402a-8b20-74f5720941fe for instance a93e643c-a780-41fb-9719-43b374afe806 on hv-cinder-80266 Jul 28 09:25:29.141266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:29.141693 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:29.145298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-edd9fc8a-7281-48c7-a89e-24ac6dff18fa req-e4bec390-42e5-44e9-8e67-627e7dc148fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029581 Jul 28 09:25:29.145887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 69/145] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:29.485304 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:29.493423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-23e89b83-1d9a-4575-8c97-7fa861bbd223 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.367042 Jul 28 09:25:29.494001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 77/146] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:29 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:30.125095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:30.126106 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:30.132717 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:30.133166 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:30.133931 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:30.134022 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:30.134419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:30.134848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:30.140912 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:30.141352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:30.142100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:30.142523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:32.939692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3e50e2da-9dcb-4bcd-9963-4d38da0e7afc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 2.802302 Jul 28 09:25:32.939692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 78/147] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:30 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:25:32.939692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:32.939692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:32.947461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:32.947566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:32.948428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:32.948862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:32.957803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-28f4cd9c-9f03-4b4e-8911-a4a80d978616 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 2.836528 Jul 28 09:25:32.959715 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 70/148] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:30 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 2839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:33.234808 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:33.251275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-badce0b3-c134-40d1-a3b3-8987febe0c98 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.316455 Jul 28 09:25:33.252017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 79/149] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:32 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:33.944426 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:33.945750 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:33.952074 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:33.952525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:33.954226 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:33.954226 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:33.969636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:33.971539 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:33.978548 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:33.979433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:33.980446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:33.981114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:34.039945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c6f0ba49-24e4-4a8a-8611-7ab3126b9c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.097372 Jul 28 09:25:34.041737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 71/150] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:33 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:34.064375 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-32a4e249-47d3-4c21-a6fd-c8f9fa11e9b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.097730 Jul 28 09:25:34.064741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 80/151] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:33 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:34.267792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-855153475", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "1b6014d4-8d11-4d4c-8401-8dbc24e8b9a9"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:34.269770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:34.270664 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:34.277262 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:34.278719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:34.280060 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:34.280816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:34.328202 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] validate_networks() for [('1b6014d4-8d11-4d4c-8401-8dbc24e8b9a9', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:25:34.512517 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:34.520862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f82f79e2-4d31-4716-b56c-19cf0c89d2a7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.255431 Jul 28 09:25:34.521436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 81/152] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:34 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:34.736724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:25:34.737283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:25:34.737749 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:25:34.738149 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:25:34.738551 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:25:34.749232 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:34.749727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:34.750567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:34.751020 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:34.767304 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Getting quotas for project 06e37808f2054fe2b42ec96a381300c1. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:25:34.771694 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Getting quotas for user c4dc3f1239854ea0b7e24ec53c7862f8 and project 06e37808f2054fe2b42ec96a381300c1. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:25:34.782437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:25:34.785500 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:25:34.833741 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7961c486-0c58-4d76-8e46-c4e43e3b057c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570109 Jul 28 09:25:34.834643 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 72/153] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:25:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:25:34.844107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9c9cca6a-c226-4c64-8d4d-7fb4394501c7 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:34.844804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9c9cca6a-c226-4c64-8d4d-7fb4394501c7 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:34.899079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9c9cca6a-c226-4c64-8d4d-7fb4394501c7 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:34.905889 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9c9cca6a-c226-4c64-8d4d-7fb4394501c7 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1213 microversion: 2.1 time: 0.065433 Jul 28 09:25:34.906677 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 82/154] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:34 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:35.055217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:35.056646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:35.064063 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.064514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.065868 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.066434 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.089543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:35.092660 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:35.103421 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.104596 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.105575 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.106006 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.142587 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-354ddf59-d4b9-45c3-a150-ddcc94be9d9b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.092772 Jul 28 09:25:35.144894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 73/155] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:35 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:25:35.183020 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1ba5e733-3239-48f0-81c0-6fc746183a46 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.101468 Jul 28 09:25:35.183824 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 83/156] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:35 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:35.193160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-306887644", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "3463c92e-9592-4a5e-be73-c0318bba2428"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:35.259689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] validate_networks() for [('3463c92e-9592-4a5e-be73-c0318bba2428', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:25:35.538622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:35.539329 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:35.545551 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.546010 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.546778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.547211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.677996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:25:35.678410 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:25:35.678877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:25:35.679276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:25:35.679703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:25:35.688370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.688805 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.689589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.690041 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.706546 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:25:35.710452 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for user 56058a59ffca404ba8121aae6e09ce3b and project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:25:35.713802 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:35.720993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:25:35.721847 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9b456a15-0b36-4dab-9a62-eb10a2b9e09f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.186606 Jul 28 09:25:35.723082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 84/157] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:35 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:35.723929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:25:35.769536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3a6ed757-9725-456c-8fd2-c7751a12db1c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581246 Jul 28 09:25:35.770017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 74/158] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:25:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:25:35.780087 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-76eb758d-501f-493d-b9d5-c3ba147aa111 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:35.780872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-76eb758d-501f-493d-b9d5-c3ba147aa111 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:35.844633 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-76eb758d-501f-493d-b9d5-c3ba147aa111 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:35.853575 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-76eb758d-501f-493d-b9d5-c3ba147aa111 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1217 microversion: 2.1 time: 0.077338 Jul 28 09:25:35.854543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 85/159] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:35 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:35.923647 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:35.924470 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:35.931347 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.931891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:35.932747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:35.933243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.043148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:36.062532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ea90d6d5-3f3e-4930-99a6-2493d040027b tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1273 microversion: 2.1 time: 0.132036 Jul 28 09:25:36.070553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 75/160] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:35 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:36.156141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:36.157143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:36.164570 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.165015 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.165782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.166429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.194978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:36.196049 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:36.210380 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.211088 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.211924 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.212358 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.286076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ee92b96a-9406-45aa-90da-4ee208eaea6a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.135072 Jul 28 09:25:36.287917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 86/161] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:36 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:36.316244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e78f0c6b-84b9-49d8-b67b-3c26a3ff7dbf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.124802 Jul 28 09:25:36.317507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 76/162] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:36 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:36.739177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:36.740078 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:36.746832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.747289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.748254 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.748685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.873823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:36.877280 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:36.884869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.885494 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.886465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:36.887080 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:36.984249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:36.993286 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-96ac0ff1-30f2-4995-a05b-6872f8502bf7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1269 microversion: 2.1 time: 0.124524 Jul 28 09:25:36.994461 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 77/163] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:36 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:37.073959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:37.084718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-17c5f342-0c74-46d6-bb0b-46289ec7f125 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.349589 Jul 28 09:25:37.085620 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 87/164] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:36 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:37.086663 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:37.087189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:37.095718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:37.097183 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:37.098501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:37.099143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:37.297458 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:37.298501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:37.308010 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:37.308465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:37.320658 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:37.321108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:37.423568 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-551d86f9-8c6b-4883-9e71-3a65dfefa148 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.129110 Jul 28 09:25:37.424355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 88/165] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:37 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:25:37.431124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:37.432675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:37.440291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:37.441328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:37.442402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:37.442859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:37.550097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3072769f-64a2-4a62-bd73-b499854b1eb3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.122624 Jul 28 09:25:37.550809 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 89/166] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:37 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:37.745676 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:37.753221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-86b51572-bda3-4bd3-adf8-f28717ec4c50 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.670129 Jul 28 09:25:37.753933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 78/167] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:37 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:38.012875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:38.013935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:38.021239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.021704 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.022523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.022904 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.105582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:38.106202 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:38.112602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.113336 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.114124 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.114560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.155801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:38.166674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-21d4596f-07c2-4cf3-8980-34ee3a684554 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1275 microversion: 2.1 time: 0.158974 Jul 28 09:25:38.168400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 90/168] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:38 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:38.373359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-4ef4fda4-03e8-49bf-892f-9e6a61e4e475 req-08388869-e4f3-4ae2-af25-523f53f836fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce759f0e-c674-439a-85b9-88df6588af10", "tag": "dc51191b-6d62-4b22-b9c0-0512eda54856"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:38.378055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:38.378055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:38.398239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-4ef4fda4-03e8-49bf-892f-9e6a61e4e475 req-08388869-e4f3-4ae2-af25-523f53f836fb service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.399733 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-4ef4fda4-03e8-49bf-892f-9e6a61e4e475 req-08388869-e4f3-4ae2-af25-523f53f836fb service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.437515 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-4ef4fda4-03e8-49bf-892f-9e6a61e4e475 req-08388869-e4f3-4ae2-af25-523f53f836fb service nova] Creating event network-changed:dc51191b-6d62-4b22-b9c0-0512eda54856 for instance ce759f0e-c674-439a-85b9-88df6588af10 on hv-cinder-80266 Jul 28 09:25:38.449042 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-4ef4fda4-03e8-49bf-892f-9e6a61e4e475 req-08388869-e4f3-4ae2-af25-523f53f836fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080882 Jul 28 09:25:38.450273 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 91/169] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:38.457138 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:38.463112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:38.466208 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:38.470344 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7d61cac0-6136-4cd0-bbcd-90dcc2b251e2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.372028 Jul 28 09:25:38.470893 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 79/170] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:38 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:38.482207 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.482661 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.483555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.484005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.564660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:38.567016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:38.578303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.578756 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.580435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.581053 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.593652 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1027a91e-1cba-46ba-9a9a-45ab3be18e59 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.141208 Jul 28 09:25:38.594612 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 92/171] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:38 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:38.689089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-596402dc-9f51-4258-ace0-2607a007021f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.131562 Jul 28 09:25:38.690183 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 80/172] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:38 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:38.777991 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:38.783566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:38.793598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.794267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:38.795203 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:38.795826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.086804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:39.111298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4da83f57-7443-419e-b9d4-756118567346 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.340835 Jul 28 09:25:39.112928 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 93/173] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:38 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:39.196479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:39.197110 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:39.210174 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.212036 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.214370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.214822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.488612 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:39.489396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:39.499529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.500758 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.501440 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.504043 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.665917 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:39.675822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-072b1a35-e515-48bf-8f60-b35190732ca3 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.494385 Jul 28 09:25:39.677458 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 81/174] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:39 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:39.684548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:39.686501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:39.694774 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.695881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.697319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.698215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.790654 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ed3646bb-4fbc-47bd-99fc-16ed5b8ced6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.111440 Jul 28 09:25:39.792238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 82/175] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:39 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:39.804545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:39.805602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:39.812775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.813226 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.814062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:39.814506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:39.857264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:39.868228 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-23f8810e-766f-4a9a-a410-a64ec4fcb8c9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.384402 Jul 28 09:25:39.869860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 94/176] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:39 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:39.919847 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8aa78d96-2f99-4721-bf72-78817d912297 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.122593 Jul 28 09:25:39.920489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 83/177] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:39 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:40.128964 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:40.129653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:40.147238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.148291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.149249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.149839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.693605 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:40.694307 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:40.700725 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.701170 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.701926 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.702353 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.720028 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:40.728731 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6ce0b23d-bc4f-4d1a-a344-1e962d39687a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.603660 Jul 28 09:25:40.729651 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 95/178] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:40 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:40.734364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-88c69e80-ae67-4478-be87-7dab3259050e req-e054ef2a-c448-44f5-bd05-7d1678055e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a17c34-a3e3-44a8-9fc2-616e75f456ad", "tag": "446844c5-42ac-4490-a52f-68f801c377f3"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:40.735846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:40.735846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:40.743056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-88c69e80-ae67-4478-be87-7dab3259050e req-e054ef2a-c448-44f5-bd05-7d1678055e85 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.743489 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-88c69e80-ae67-4478-be87-7dab3259050e req-e054ef2a-c448-44f5-bd05-7d1678055e85 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.754782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-88c69e80-ae67-4478-be87-7dab3259050e req-e054ef2a-c448-44f5-bd05-7d1678055e85 service nova] Creating event network-changed:446844c5-42ac-4490-a52f-68f801c377f3 for instance a7a17c34-a3e3-44a8-9fc2-616e75f456ad on hv-cinder-80266 Jul 28 09:25:40.759739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-88c69e80-ae67-4478-be87-7dab3259050e req-e054ef2a-c448-44f5-bd05-7d1678055e85 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028811 Jul 28 09:25:40.760783 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 96/179] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:40.802932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:40.804018 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:40.810163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.810601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.811359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.811910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.899799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:40.905832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-074b22a4-d08f-4d68-a42d-c2688fa57ede tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.106760 Jul 28 09:25:40.906997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 97/180] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:40 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:25:40.908163 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b992128c-df67-499d-af95-2a3b1528cbc0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.218879 Jul 28 09:25:40.909073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 84/181] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:40 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:40.912495 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:40.913196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:40.919663 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.920117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.920883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.921315 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.930471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:40.931693 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:40.937483 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.938379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:40.939204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:40.940404 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.021387 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fb7f96ad-1d1e-4c89-bbf0-6ec0bf903f3f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.094662 Jul 28 09:25:41.025557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 85/182] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:40 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:41.076343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:41.085564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5ae7dc95-68bb-4f34-873f-80e752eb8971 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.177230 Jul 28 09:25:41.086142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 98/183] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:40 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:41.746195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:41.746852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:41.754464 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.754911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.755770 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.756208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.816778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:41.817826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:41.825261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.836290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.837163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.837776 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.864255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:25:41.925061 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:41.933840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f4ea8ce7-8105-48dd-b692-37c505968107 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.191782 Jul 28 09:25:41.944243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 86/184] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:41 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:41.949766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:41.950728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:41.958399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.959145 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.960161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.960908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.975965 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-edbeb170-6987-4253-b01a-455955e2deff tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 204 len: 0 microversion: 2.1 time: 0.163782 Jul 28 09:25:41.979614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 99/185] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:25:41 2021] DELETE /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:25:41.983363 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:41.984197 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:41.990953 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.991499 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:41.992566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:41.993117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.038639 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3131599b-e146-4e4f-b5e0-d0bb3be877cd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.092715 Jul 28 09:25:42.039381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 87/186] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:41 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:42.044670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:42.045397 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:42.052949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.053395 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.054171 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.054601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.154405 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:42.162938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2fc653c5-a812-4f2a-90ba-7925546e4d32 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.184699 Jul 28 09:25:42.163507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 100/187] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:41 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:42.170712 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:42.172445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:42.178467 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.178918 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.179723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.180167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.207462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:42.215466 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6e52d58b-b50d-4cf2-8793-8216e17c9ef9 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1553 microversion: 2.1 time: 0.174735 Jul 28 09:25:42.216070 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 88/188] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:42 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:42.220443 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:42.221657 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:42.227132 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.227623 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.228423 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.228850 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.290913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-90656f28-6b36-45cd-95a5-866bf38b2ac7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.126072 Jul 28 09:25:42.294272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 101/189] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:42 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:42.351872 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:42.359233 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b3d47eed-3bc4-4a34-aaf2-91d12a6d8862 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.142208 Jul 28 09:25:42.360103 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 89/190] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:42 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:42.953219 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:42.953219 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:42.959631 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.960079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:42.960839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:42.961429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.049604 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:43.050588 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:43.056898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.057348 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.058174 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.058634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.093378 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:43.106501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3c8e68ff-4f2a-441a-926b-70edc83cd579 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.159100 Jul 28 09:25:43.107188 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 102/191] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:42 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:43.129824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-51918dc3-c738-4b44-a31f-1975e5537cec tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.083823 Jul 28 09:25:43.130442 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 90/192] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:43 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:25:43.180383 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:43.181073 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:43.190230 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.191164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.192074 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.192530 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.233211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:43.233916 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:43.246834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.247294 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.248751 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.249190 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.370017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:43.379084 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7d02cf41-ed2f-47c0-9ecf-f8604bc35f0b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.203060 Jul 28 09:25:43.387934 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 103/193] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:43 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:43.392619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:43.394194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:43.403242 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.403242 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.403993 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.404418 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.445239 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:43.454376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-92832731-2bdf-4a09-8e6b-756ad1aef693 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1553 microversion: 2.1 time: 0.225063 Jul 28 09:25:43.454918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 91/194] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:43 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1553 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:43.459906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:43.460506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:43.466006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.466448 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.467274 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:43.467963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:43.480107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a20e50de-1002-40ae-ab52-a0195bfc9427 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14 microversion: 2.20 time: 0.090799 Jul 28 09:25:43.481482 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 104/195] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:43 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:43.599685 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:43.610105 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d5abcee7-9407-4ce2-9233-22fbd88e8406 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.153541 Jul 28 09:25:43.620627 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 92/196] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:43 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:44.124278 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:44.124977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:44.138730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.138959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.139940 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.140293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:44.140752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.141228 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:44.147189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.147663 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.148433 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.148866 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.223843 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6ef51559-4b62-4a7c-815e-8e6e55ae4e47 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 14 microversion: 2.1 time: 0.086973 Jul 28 09:25:44.227139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 93/197] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:44 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:44.276077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:44.285162 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e7a46350-8724-4a03-842e-cd89441c31af tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.164852 Jul 28 09:25:44.285741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 105/198] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:44 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:44.396290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:44.397040 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:44.403831 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.404373 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.405319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.406112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.471248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:44.471904 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:44.477949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.478397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.479323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.479767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.679442 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:44.690399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7a501691-426e-41c7-824d-e78618725a6b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.297521 Jul 28 09:25:44.691671 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 94/199] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:44 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:44.704064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:44.705645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:44.713755 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.714272 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.715267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.715803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.793864 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:44.802438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-73e55804-3f65-47b2-b452-2130b0bd95e1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 6139 microversion: 2.20 time: 0.109074 Jul 28 09:25:44.803101 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 95/200] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:44 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 6139 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:25:44.811342 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:44.811732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-869783d9-255b-4950-b0c3-93186d8e1940 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1553 microversion: 2.1 time: 0.343932 Jul 28 09:25:44.812301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 106/201] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:44 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:44.821729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:44.828355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.828801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:44.829574 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:44.830005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.057092 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:45.066567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8a852297-610a-474c-babe-8c9f56009480 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.262017 Jul 28 09:25:45.067444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 96/202] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:44 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:45.239326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:45.242512 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-8b679493-f1c0-4006-b9a1-dcfe22eaae70 req-7c449a02-230a-427c-894f-291a04d72c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3553763b-4ea7-46c3-a243-3e7217b9f319", "name": "network-vif-deleted", "tag": "eca2dda2-dd14-4098-a22d-67e6250c6eb4"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:45.244454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:45.248043 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:45.248043 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:45.264496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.264949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.265973 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.266402 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.268831 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8b679493-f1c0-4006-b9a1-dcfe22eaae70 req-7c449a02-230a-427c-894f-291a04d72c72 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.269394 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8b679493-f1c0-4006-b9a1-dcfe22eaae70 req-7c449a02-230a-427c-894f-291a04d72c72 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.282889 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-8b679493-f1c0-4006-b9a1-dcfe22eaae70 req-7c449a02-230a-427c-894f-291a04d72c72 service nova] Creating event network-vif-deleted:eca2dda2-dd14-4098-a22d-67e6250c6eb4 for instance 3553763b-4ea7-46c3-a243-3e7217b9f319 on hv-cinder-80266 Jul 28 09:25:45.288981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-8b679493-f1c0-4006-b9a1-dcfe22eaae70 req-7c449a02-230a-427c-894f-291a04d72c72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062906 Jul 28 09:25:45.294098 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 107/203] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:45.303234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:45.303968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:45.310525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.310962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.311767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.312349 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.349788 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2b90e7b4-36c4-4432-a4b1-892e8ef55ab3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 7711 microversion: 2.1 time: 0.118965 Jul 28 09:25:45.350678 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 97/204] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:45 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 7711 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:45.444387 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:45.451842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b1bbd25f-9ed8-4a00-8be5-138118a1156d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.154726 Jul 28 09:25:45.452672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 108/205] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:45 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:45.710279 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:45.711621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:45.722703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.723480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.725082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.725736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.814299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:45.815846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:45.822009 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.822962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.824121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.824800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.905171 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0770f717-7b64-45ba-af38-bb28505173f8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 10502 microversion: 2.20 time: 0.094614 Jul 28 09:25:45.909370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 109/206] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:45 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 10502 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:25:45.913250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:45.916505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:45.928365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.928994 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.929973 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.930560 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.968538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:45.980637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:45.981096 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:45.981554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lazy-loading 'fault' on Instance uuid 3553763b-4ea7-46c3-a243-3e7217b9f319 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:25:45.982257 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e4e9c6b3-bf2a-4f23-816e-ada904d091cb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.278254 Jul 28 09:25:45.982828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 98/207] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:45 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:45.998732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-be32d948-5b84-4f1d-badc-9d4878567f0c req-f790cc17-94ca-4326-960c-5d84e6b75e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce759f0e-c674-439a-85b9-88df6588af10", "name": "network-vif-plugged", "status": "completed", "tag": "dc51191b-6d62-4b22-b9c0-0512eda54856"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:46.005649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:46.005649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:25:46.028800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-be32d948-5b84-4f1d-badc-9d4878567f0c req-f790cc17-94ca-4326-960c-5d84e6b75e70 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.032051 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-be32d948-5b84-4f1d-badc-9d4878567f0c req-f790cc17-94ca-4326-960c-5d84e6b75e70 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.044691 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-be32d948-5b84-4f1d-badc-9d4878567f0c req-f790cc17-94ca-4326-960c-5d84e6b75e70 service nova] Creating event network-vif-plugged:dc51191b-6d62-4b22-b9c0-0512eda54856 for instance ce759f0e-c674-439a-85b9-88df6588af10 on hv-cinder-80266 Jul 28 09:25:46.052204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-be32d948-5b84-4f1d-badc-9d4878567f0c req-f790cc17-94ca-4326-960c-5d84e6b75e70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067797 Jul 28 09:25:46.053119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 99/208] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:46.086374 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce47c86afac940bda659ec082e075445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e465e5255d9401caf2f0f22d0b6e7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:46.087543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:46.088444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:46.099398 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-39248c5e-c705-4f37-be21-02c432844dd2 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 200 len: 1350 microversion: 2.1 time: 0.190871 Jul 28 09:25:46.106218 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.107059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.109101 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.109576 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 110/209] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:45 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 1350 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:46.113477 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.363055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:46.364791 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:46.372955 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.373414 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.376660 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.379645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.414576 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:46.423627 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-593310e9-6240-4312-9f78-8b85c29cb231 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.343015 Jul 28 09:25:46.427766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:46 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:46.470030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:46.471428 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:46.479918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.480409 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.488413 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.489206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.651528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:46.662341 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-616bfda5-9f26-4f86-9334-26f9c7757fff tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.196848 Jul 28 09:25:46.668088 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-734a4814-a443-4e81-80e9-7503c9965246 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 12548 microversion: 2.1 time: 0.309554 Jul 28 09:25:46.668549 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 101/211] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:46 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:46.673556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 111/212] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:46 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 12548 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:46.916770 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:46.917741 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:46.924900 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.925365 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.926139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:46.926571 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:46.999329 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:47.000223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:47.007828 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.008277 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.009049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.009478 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.037470 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-edcde25b-97e2-4b30-84dd-6b95f7053568 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 14558 microversion: 2.20 time: 0.124020 Jul 28 09:25:47.038860 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 102/213] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:46 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 14558 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:47.118934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:47.120197 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:47.127164 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.128525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.129548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.130321 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.147751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:47.155248 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] HTTP exception thrown: Instance 3553763b-4ea7-46c3-a243-3e7217b9f319 could not be found. Jul 28 09:25:47.155882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Returning 404 to user: Instance 3553763b-4ea7-46c3-a243-3e7217b9f319 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:25:47.156120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ce005063-3b84-4031-9aae-b6bccd0c037d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.160655 Jul 28 09:25:47.156980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e2c310ce-8b32-492a-a727-ef428a6c3ee3 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 404 len: 111 microversion: 2.1 time: 0.042021 Jul 28 09:25:47.157306 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 112/214] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:46 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:47.157713 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 103/215] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:47 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:25:47.446491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:47.447168 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:47.473924 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.474466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.475465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.476532 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.640291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:47.649301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-787fd269-cbd4-4af0-9c92-e34601dcf9a4 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1521 microversion: 2.1 time: 0.206679 Jul 28 09:25:47.661024 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 113/216] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:47 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:47.680203 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:47.680817 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:47.686114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:47.686719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.687172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.687964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.688112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:47.688678 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.697697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.698621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.699636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:47.700509 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:47.794921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9a78a4ec-fd16-4407-8864-df8f4f256bda tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 15025 microversion: 2.1 time: 0.113870 Jul 28 09:25:47.799655 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 114/217] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:47 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 15025 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:47.845589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:47.857619 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3580bade-4a7c-40e9-94c6-2b463c2eb263 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1313 microversion: 2.1 time: 0.180939 Jul 28 09:25:47.858383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 104/218] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:47 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:48.057308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:48.059044 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.075787 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.079847 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.084331 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.084769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.176106 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.177241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.188041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-aa70e54a-3be6-4ffd-a263-aa433d1adf11 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 16151 microversion: 2.20 time: 0.142774 Jul 28 09:25:48.188899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 115/219] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:48 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 16151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:48.200496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.200944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.201720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.202149 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.360887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:48.369180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7d8cc6d6-e163-4485-83a6-a25654923c1a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.198823 Jul 28 09:25:48.369881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 105/220] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:48 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:48.521776 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.522359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.529873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.530561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.531778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.532418 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.547476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] HTTP exception thrown: Instance 3553763b-4ea7-46c3-a243-3e7217b9f319 could not be found. Jul 28 09:25:48.548127 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Returning 404 to user: Instance 3553763b-4ea7-46c3-a243-3e7217b9f319 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:25:48.548997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2a66adde-8cd1-4e72-b6bf-3145bfdb41cd tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 404 len: 111 microversion: 2.1 time: 0.031928 Jul 28 09:25:48.549817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 116/221] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:25:48 2021] DELETE /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:25:48.557616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.558530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] [instance: 3553763b-4ea7-46c3-a243-3e7217b9f319] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.565453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.565908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.566684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.567311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.582072 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] HTTP exception thrown: Instance 3553763b-4ea7-46c3-a243-3e7217b9f319 could not be found. Jul 28 09:25:48.582805 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] Returning 404 to user: Instance 3553763b-4ea7-46c3-a243-3e7217b9f319 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:25:48.583774 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a9f3cb91-ae44-495c-80d6-4fe77ea70778 tempest-DeleteServersTestJSON-1094374724 tempest-DeleteServersTestJSON-1094374724-project] 10.222.0.23 "GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319" status: 404 len: 111 microversion: 2.1 time: 0.030164 Jul 28 09:25:48.584438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 106/222] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:48 2021] GET /compute/v2.1/servers/3553763b-4ea7-46c3-a243-3e7217b9f319 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:25:48.672698 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.673307 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.685169 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.687634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.689911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.691826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.807558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:48.808529 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.818188 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.818639 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.822570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.823036 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.936012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-21b96704-f14a-4c25-bb05-0646ed0a2c05 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 17602 microversion: 2.1 time: 0.132732 Jul 28 09:25:48.937448 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 107/223] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:48 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 17602 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:48.946802 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:48.949162 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:48.963888 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.964229 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:48.964500 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.965298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:48.965969 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:48.978277 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-266948b9-b24c-4203-ba22-ab44eee2805c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1501 microversion: 2.1 time: 0.314337 Jul 28 09:25:48.979190 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 117/224] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:48 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1501 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:49.004688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:49.006422 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:49.012998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.014323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.015501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.016177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.252265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:49.261867 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2af11292-99dc-4c89-b2b9-f8bb1a75afcc tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1497 microversion: 2.1 time: 0.322875 Jul 28 09:25:49.262439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 108/225] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:48 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:49.268359 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:49.269615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:49.277182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.278907 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.279897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.281001 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.323297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:49.333565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a8d61705-4643-44da-9b01-9b634e5605e8 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1516 microversion: 2.1 time: 0.332666 Jul 28 09:25:49.336967 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 118/226] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:48 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1516 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:49.381657 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ac6d8e5a-7637-4d23-891f-621797e059ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 17861 microversion: 2.20 time: 0.117899 Jul 28 09:25:49.382358 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 109/227] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:49 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 17861 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:49.387873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:49.388491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:49.400461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.400925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.401688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.402276 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.911785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-d1f5821c-714c-49d9-924a-e95b5875868e req-21c88de8-3e9f-43fe-92eb-ec230176a810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a17c34-a3e3-44a8-9fc2-616e75f456ad", "name": "network-vif-plugged", "status": "completed", "tag": "446844c5-42ac-4490-a52f-68f801c377f3"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:49.914159 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:49.914159 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:25:49.922846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-d1f5821c-714c-49d9-924a-e95b5875868e req-21c88de8-3e9f-43fe-92eb-ec230176a810 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.923808 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-d1f5821c-714c-49d9-924a-e95b5875868e req-21c88de8-3e9f-43fe-92eb-ec230176a810 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.937791 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-d1f5821c-714c-49d9-924a-e95b5875868e req-21c88de8-3e9f-43fe-92eb-ec230176a810 service nova] Creating event network-vif-plugged:446844c5-42ac-4490-a52f-68f801c377f3 for instance a7a17c34-a3e3-44a8-9fc2-616e75f456ad on hv-cinder-80266 Jul 28 09:25:49.945927 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-d1f5821c-714c-49d9-924a-e95b5875868e req-21c88de8-3e9f-43fe-92eb-ec230176a810 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040586 Jul 28 09:25:49.946815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 110/228] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:25:49.953183 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:49.954389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:49.962571 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.963966 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:49.967962 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:49.968470 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.023894 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:50.035992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1974a7bf-fccc-4eb5-a6f4-b8aa59d66e3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.652162 Jul 28 09:25:50.037352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 119/229] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:49 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:50.063354 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e95932cc-365b-4f4b-a37a-3c080cf2aa71 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 17686 microversion: 2.1 time: 0.114902 Jul 28 09:25:50.065321 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 111/230] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:49 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 17686 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:50.185812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:50.186307 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:50.193869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.194341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.195108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.195534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.222396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:25:50.306308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f4533adb-dd6d-4179-bc1e-4f79c6a661ca tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 204 len: 0 microversion: 2.1 time: 0.123896 Jul 28 09:25:50.307228 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 120/231] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:25:50 2021] DELETE /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:25:50.317443 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:50.318551 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:50.328100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.329010 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.330715 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.331657 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.398139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:50.399434 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:50.413798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.415076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.418284 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.418729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.511211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:50.524020 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5f99d418-a0a1-455c-b944-304dddb37ea0 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1503 microversion: 2.1 time: 0.208233 Jul 28 09:25:50.524598 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 112/232] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:50 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:50.754920 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3439a37d-b384-4252-94a8-69c7b3173c13 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 18449 microversion: 2.20 time: 0.361967 Jul 28 09:25:50.755962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 121/233] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:50 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 18449 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:50.854946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:50.856530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:50.864922 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.865799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.866822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:50.867791 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:50.896881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lazy-loading 'flavor' on Instance uuid 722bacfd-c01b-427f-a5db-de2581b3dc2e {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:25:51.023539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0fd360ed-7704-434f-b2ef-56fa69a08303 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action" status: 200 len: 32 microversion: 2.1 time: 0.173875 Jul 28 09:25:51.024406 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 113/234] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:50 2021] POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:25:51.036753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:51.037539 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:51.044735 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.045193 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.045989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.046642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.054303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:51.055193 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:51.064591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.065256 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.066009 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.066541 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.363596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:51.377517 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:51.380067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-98724dfd-499f-4295-b227-ea5b496d5555 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1317 microversion: 2.1 time: 0.327783 Jul 28 09:25:51.380797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 114/235] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:51 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:51.389913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-71524056-4c78-42c2-84ad-cd837b68a4f3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.355026 Jul 28 09:25:51.389913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 122/236] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:51 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:51.390240 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:51.391136 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:51.396958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.397403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.398175 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.398608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.526778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fba125f5-2516-4622-a38d-a6dc6457bfe7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 19342 microversion: 2.1 time: 0.139913 Jul 28 09:25:51.528116 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 123/237] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:51 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 19342 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:51.540224 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:51.541039 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:51.549208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.549836 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.550822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.551410 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.774275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:51.779488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:51.793610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.796052 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.796192 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:51.799858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:51.801213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:51.809275 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3c70fabe-29d9-4425-aa85-e93b087613d1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1503 microversion: 2.1 time: 0.272358 Jul 28 09:25:51.810102 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 115/238] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:51 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:51.935627 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6342d2c6-0b81-4ce1-8e71-133785b63324 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 19342 microversion: 2.20 time: 0.172204 Jul 28 09:25:51.937155 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 124/239] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:51 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 19342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:52.397412 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:52.398497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.406708 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:52.408656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.411013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.411717 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.412680 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.413402 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.415670 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.416121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.416904 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.417341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.619386 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:52.620695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:52.630161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-20d78bb3-e363-4dc7-a7e5-a90f7493b281 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1507 microversion: 2.1 time: 0.236722 Jul 28 09:25:52.632065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e48dccc1-2283-4b41-9f1f-708f02138aba tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.229618 Jul 28 09:25:52.632199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 116/240] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:52 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:52.632867 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 125/241] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:52 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:52.648451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "655af95f-52d2-4191-b3a7-d37edf0ab4da"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:52.649572 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.655123 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:52.656170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.656698 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.657244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.657599 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.658290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.664233 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.665318 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.666227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.666778 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.750769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] HTTP exception thrown: Invalid volume: volume 655af95f-52d2-4191-b3a7-d37edf0ab4da is already attached to instances: 6e1287df-cb69-4058-b6ed-b2156f10ea45 Jul 28 09:25:52.751407 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Returning 400 to user: Invalid volume: volume 655af95f-52d2-4191-b3a7-d37edf0ab4da is already attached to instances: 6e1287df-cb69-4058-b6ed-b2156f10ea45 {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:25:52.752454 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fb3bbc9d-4dae-4b8e-b8eb-3abb31c3dd19 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107713 Jul 28 09:25:52.753016 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 126/242] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:25:52 2021] POST /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 09:25:52.770382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0b6dac7e-072b-4693-a229-d634a53b239e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 20756 microversion: 2.1 time: 0.123592 Jul 28 09:25:52.771633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 117/243] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:52 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 20756 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:52.828062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:52.828613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.835339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.836296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.848749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.849217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.868738 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:52.869360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.876193 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.876633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.877910 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.878332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.977309 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:52.984747 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b8ec4476-e652-4d7c-bb2b-64640c7d290c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1503 microversion: 2.1 time: 0.160840 Jul 28 09:25:52.985305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 127/244] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:52 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:52.990059 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:52.991041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:52.996744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.997136 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:52.998024 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:52.998461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:53.006974 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lazy-loading 'services' on Instance uuid 6e1287df-cb69-4058-b6ed-b2156f10ea45 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:25:53.074099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2a8f003b-9b9a-4d92-b2e1-43fbead338e9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 20990 microversion: 2.20 time: 0.087577 Jul 28 09:25:53.078022 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 128/245] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:52 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 20990 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:53.122519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a61eb656-0ab0-499d-af89-14714d51b25c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45/os-volume_attachments/655af95f-52d2-4191-b3a7-d37edf0ab4da" status: 202 len: 0 microversion: 2.1 time: 0.257654 Jul 28 09:25:53.123298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 118/246] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:25:52 2021] DELETE /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45/os-volume_attachments/655af95f-52d2-4191-b3a7-d37edf0ab4da => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:25:53.652333 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:53.653913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:53.660164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:53.660632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:53.661436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:53.661869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:53.782060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:53.783137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:53.789379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:53.789903 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:53.790721 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:53.791161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:53.845356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:53.853346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-95b4225a-18b7-4a33-8645-767895974edf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.204803 Jul 28 09:25:53.854151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 129/247] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:53 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:53.875731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6dfe4a72-e837-4034-947a-8d940179dc43 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 22063 microversion: 2.1 time: 0.093972 Jul 28 09:25:53.877251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 119/248] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:53 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 22063 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:25:53.997390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-7abbd3b4-98b5-4889-8f98-7ed1e34b7da4 req-e1ab8339-192b-45fd-8528-d4a2605fa6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce759f0e-c674-439a-85b9-88df6588af10", "name": "network-vif-deleted", "tag": "dc51191b-6d62-4b22-b9c0-0512eda54856"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:54.002873 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:54.003184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:54.003184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:54.003894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:54.010707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.011159 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.011951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.012082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-7abbd3b4-98b5-4889-8f98-7ed1e34b7da4 req-e1ab8339-192b-45fd-8528-d4a2605fa6d7 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.012440 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-7abbd3b4-98b5-4889-8f98-7ed1e34b7da4 req-e1ab8339-192b-45fd-8528-d4a2605fa6d7 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.012646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.028507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-7abbd3b4-98b5-4889-8f98-7ed1e34b7da4 req-e1ab8339-192b-45fd-8528-d4a2605fa6d7 service nova] Creating event network-vif-deleted:dc51191b-6d62-4b22-b9c0-0512eda54856 for instance ce759f0e-c674-439a-85b9-88df6588af10 on hv-cinder-80266 Jul 28 09:25:54.035060 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-7abbd3b4-98b5-4889-8f98-7ed1e34b7da4 req-e1ab8339-192b-45fd-8528-d4a2605fa6d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041418 Jul 28 09:25:54.037366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 130/249] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:54.086956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:54.088025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:54.089035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:54.095534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.096609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.097454 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.097887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.108204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c81fbf19-b865-4000-87b8-55bbec3e6e84 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 200 len: 1461 microversion: 2.1 time: 0.109954 Jul 28 09:25:54.109005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 120/250] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:53 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 1461 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:54.179407 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6076db96-8ac3-4b44-a675-533fb9bc258c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 22210 microversion: 2.20 time: 0.095667 Jul 28 09:25:54.181353 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 131/251] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:54 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 22210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:25:54.343601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2059035268", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "3463c92e-9592-4a5e-be73-c0318bba2428"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:54.400256 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] validate_networks() for [('3463c92e-9592-4a5e-be73-c0318bba2428', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:25:54.810093 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:25:54.810692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:25:54.810978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:25:54.811383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:25:54.811834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:25:54.820499 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.820948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.821746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.822208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.839401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:25:54.843324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for user 56058a59ffca404ba8121aae6e09ce3b and project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:25:54.854514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:25:54.856755 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:25:54.870411 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:54.871108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:54.877636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.878068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.878825 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.879250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.901214 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-77044b09-444c-426e-98cc-3ee850117fb6 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561203 Jul 28 09:25:54.902055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 121/252] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:25:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:25:54.906628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:54.907723 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:54.914414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.914936 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.915774 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:54.916213 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:54.989903 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0534f63f-c4a1-49b3-afa4-b25242a695e1 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 23223 microversion: 2.1 time: 0.086609 Jul 28 09:25:54.993814 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 122/253] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:54 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 23223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:54.999405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6dbc14a7-73ba-4f92-909e-b4ef2a36a55b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:55.000219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6dbc14a7-73ba-4f92-909e-b4ef2a36a55b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:55.012476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:55.020907 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-dfc0ac2f-7d9e-49f6-b175-4f0ad6594d42 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.154406 Jul 28 09:25:55.021794 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 132/254] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:54 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:55.060753 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6dbc14a7-73ba-4f92-909e-b4ef2a36a55b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:55.067913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6dbc14a7-73ba-4f92-909e-b4ef2a36a55b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1218 microversion: 2.1 time: 0.072026 Jul 28 09:25:55.068115 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 123/255] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:54 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:55.125903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:55.126519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: ce759f0e-c674-439a-85b9-88df6588af10] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:55.132860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:55.133316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:55.134196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:55.134631 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:55.148559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] HTTP exception thrown: Instance ce759f0e-c674-439a-85b9-88df6588af10 could not be found. Jul 28 09:25:55.149179 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Returning 404 to user: Instance ce759f0e-c674-439a-85b9-88df6588af10 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:25:55.150011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-887c98a8-af58-4cfb-8011-d11e49421d93 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10" status: 404 len: 111 microversion: 2.1 time: 0.027843 Jul 28 09:25:55.150552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 133/256] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:55 2021] GET /compute/v2.1/servers/ce759f0e-c674-439a-85b9-88df6588af10 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:25:55.192338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:55.193302 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:55.200757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:55.201500 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:55.202408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:55.202978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:55.260760 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1205179295", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "1b6014d4-8d11-4d4c-8401-8dbc24e8b9a9"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:55.275317 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8521c843-2451-4504-bbec-f0e6888a7bae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 23793 microversion: 2.20 time: 0.087089 Jul 28 09:25:55.279503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 124/257] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:55 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 23793 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:25:55.320591 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] validate_networks() for [('1b6014d4-8d11-4d4c-8401-8dbc24e8b9a9', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:25:55.686530 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:25:55.686970 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:25:55.687443 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:25:55.687884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:25:55.688296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:25:55.697669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:55.698114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:55.698917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:55.699354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:55.715700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Getting quotas for project 06e37808f2054fe2b42ec96a381300c1. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:25:55.719683 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Getting quotas for user c4dc3f1239854ea0b7e24ec53c7862f8 and project 06e37808f2054fe2b42ec96a381300c1. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:25:55.731692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:25:55.733999 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:25:55.778421 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-42f96f48-38d3-47b2-bfa4-4be36cfd8c6a tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521599 Jul 28 09:25:55.784558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 134/258] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:25:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:25:55.790204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0dcb7efd-e6ee-4dd7-bac9-fd42116c541c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:55.790897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0dcb7efd-e6ee-4dd7-bac9-fd42116c541c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:55.859855 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0dcb7efd-e6ee-4dd7-bac9-fd42116c541c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:55.865054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0dcb7efd-e6ee-4dd7-bac9-fd42116c541c tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1214 microversion: 2.1 time: 0.078372 Jul 28 09:25:55.865730 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 125/259] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:55 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:56.003050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:56.006586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:56.013986 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.014624 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.015401 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.015862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.039889 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:56.040667 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:56.051454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.053252 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.055430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.056177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.097119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4a53f0d0-936d-47d8-8221-99f6da2d993b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 24456 microversion: 2.1 time: 0.098927 Jul 28 09:25:56.098012 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 135/260] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:55 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 24456 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:56.109610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:56.110551 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:56.120855 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.121824 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.123198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.123937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.270102 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:56.284908 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f59f883e-209a-481b-8fda-cb6a86efaf04 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1288 microversion: 2.1 time: 0.185406 Jul 28 09:25:56.285766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 136/261] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:56 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:56.292427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:56.293984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:56.303629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.304476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.305491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.307027 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.425508 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:56.425821 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2411a054-b5a5-43ef-8da7-f9fdb5b863b3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 24678 microversion: 2.20 time: 0.137141 Jul 28 09:25:56.427142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 137/262] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:56 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 24678 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:56.438595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a8464575-4720-4946-b1eb-329897f7c87c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.403922 Jul 28 09:25:56.439229 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 126/263] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:56 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:56.882648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:56.883344 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:56.893494 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.894370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:56.895512 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:56.896139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.007727 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:57.019152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cfc4d4fd-0d76-4ab5-8623-aa8a325a2f33 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1266 microversion: 2.1 time: 0.140992 Jul 28 09:25:57.020200 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 138/264] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:56 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:57.109098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:57.109933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:57.116958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.117405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.118224 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.118719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.220904 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-484bfb5e-1fb7-4780-a36b-7df39d83ec60 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 25304 microversion: 2.1 time: 0.115196 Jul 28 09:25:57.221662 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 127/265] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:57 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 25304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:57.302744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:57.303502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:57.310404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.310854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.311672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.312113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.438609 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:57.440012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:57.447055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.448733 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.451015 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.451397 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.533309 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-822f7848-d257-4be7-afdd-0c5b1e15d946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 25459 microversion: 2.20 time: 0.098156 Jul 28 09:25:57.537812 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 128/266] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:57 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 25459 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:57.541982 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:57.542956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:57.549731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.550180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.550943 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:57.551377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:57.791828 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:57.799240 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9997620d-1c42-4ee5-9dfb-8baf332f518c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.501099 Jul 28 09:25:57.799876 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 139/267] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:57 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:57.886607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:57.894616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9660e0e4-cab8-4478-a96c-f481c23d7cb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.359120 Jul 28 09:25:57.895449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 129/268] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:57 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:58.044391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:58.045688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:58.052899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.053427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.054276 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.054802 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.139903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:58.149398 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9317198d-c0e8-4fec-92a6-4ac19e6ca8d5 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1272 microversion: 2.1 time: 0.109306 Jul 28 09:25:58.150246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 140/269] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:58 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:58.232762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:58.233799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:58.245351 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.245873 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.246725 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.247225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.313298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-24f24945-972e-475b-97d5-af6b03a146f5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 26206 microversion: 2.1 time: 0.083983 Jul 28 09:25:58.314460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 130/270] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:58 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 26206 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:25:58.368530 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-1470cfe2-4ffa-4ef9-9697-bfebb0c98873 req-a382c1c9-3578-42f2-8df0-6d5d944a5784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cf3764-aba2-4eae-aede-98a02e101b36", "tag": "1d9fa0e6-e536-4fd0-8183-daae01924304"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:58.370671 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:25:58.370671 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:25:58.379999 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-1470cfe2-4ffa-4ef9-9697-bfebb0c98873 req-a382c1c9-3578-42f2-8df0-6d5d944a5784 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.380987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-1470cfe2-4ffa-4ef9-9697-bfebb0c98873 req-a382c1c9-3578-42f2-8df0-6d5d944a5784 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.397509 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-1470cfe2-4ffa-4ef9-9697-bfebb0c98873 req-a382c1c9-3578-42f2-8df0-6d5d944a5784 service nova] Creating event network-changed:1d9fa0e6-e536-4fd0-8183-daae01924304 for instance f5cf3764-aba2-4eae-aede-98a02e101b36 on hv-cinder-80266 Jul 28 09:25:58.402834 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-1470cfe2-4ffa-4ef9-9697-bfebb0c98873 req-a382c1c9-3578-42f2-8df0-6d5d944a5784 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037854 Jul 28 09:25:58.403433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 141/271] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:25:58.545890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:58.546931 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:58.553926 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.554363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.555328 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.555553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.642222 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2a7dece0-275d-4088-966e-7ccb04e2b1b7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 26597 microversion: 2.20 time: 0.099967 Jul 28 09:25:58.645886 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 131/272] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:58 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 26597 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:25:58.816602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:58.817302 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:58.824568 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.825192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.826131 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.826724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.916789 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:58.917708 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:58.924297 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.924782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:58.925558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:58.925994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.182857 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:59.198350 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ec6556ef-1ebb-4c38-b3c2-ba6e8c6b3c8a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.379138 Jul 28 09:25:59.198350 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 142/273] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:58 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:59.206224 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:25:59.207587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:59.213792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:59.214238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.215003 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:59.215597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.256951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:59.266650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c50f3978-7281-436f-98a9-89a02f30781c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.357801 Jul 28 09:25:59.269069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 132/274] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:58 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:25:59.335221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:59.335221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:59.335221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:59.335221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.335610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:59.335610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.416376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-976023e9-9650-48a8-a295-c0ff283d25ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 26907 microversion: 2.1 time: 0.094610 Jul 28 09:25:59.417204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 133/275] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:25:59 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 26907 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:25:59.578884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:25:59.587280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-deee6783-7772-4273-9309-64cd7d18ad17 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.385365 Jul 28 09:25:59.587903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 143/276] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:25:59 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:25:59.655207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:25:59.656247 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:25:59.662953 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:59.663468 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.664317 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:25:59.664881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:25:59.742999 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9e6b8fe0-15af-4ad7-827f-1d4631c8dfc2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 27112 microversion: 2.20 time: 0.092478 Jul 28 09:25:59.746877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 134/277] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:25:59 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 27112 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:00.208050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:00.209416 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:00.216697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.217322 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.218294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.218875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.287187 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:00.287918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:00.294617 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.295091 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.295944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.296371 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.685705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:00.688101 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:00.698065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-75c9ae60-13ff-4816-9581-7abf1525aaaf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.415409 Jul 28 09:26:00.700316 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 135/278] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:00 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:00.712139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:00.714821 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:00.721091 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a8450841-53db-40a6-9a24-cb8c9cce080f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.516144 Jul 28 09:26:00.725053 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 144/279] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:00 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:00.725633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.726340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.727129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.727833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.738152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-cd4cdcba-149a-489c-b2c5-603259b4c4df req-58a64fdf-bb87-4949-9da6-58a0dcceb735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2767cd35-0a35-4b78-9b72-107f31874ebb", "tag": "7b6afacf-2a40-45fe-bf93-2fd883badc12"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:00.743290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:26:00.743290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:26:00.751722 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-cd4cdcba-149a-489c-b2c5-603259b4c4df req-58a64fdf-bb87-4949-9da6-58a0dcceb735 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.751893 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-cd4cdcba-149a-489c-b2c5-603259b4c4df req-58a64fdf-bb87-4949-9da6-58a0dcceb735 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.779798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-cd4cdcba-149a-489c-b2c5-603259b4c4df req-58a64fdf-bb87-4949-9da6-58a0dcceb735 service nova] Creating event network-changed:7b6afacf-2a40-45fe-bf93-2fd883badc12 for instance 2767cd35-0a35-4b78-9b72-107f31874ebb on hv-cinder-80266 Jul 28 09:26:00.791788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-cd4cdcba-149a-489c-b2c5-603259b4c4df req-58a64fdf-bb87-4949-9da6-58a0dcceb735 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059025 Jul 28 09:26:00.791788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 145/280] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:26:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:00.792341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:00.793626 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:00.801438 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.801899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.802690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.803128 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.866432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fb1b9f23-22a2-49b1-9514-2bf491490892 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 27438 microversion: 2.1 time: 0.163385 Jul 28 09:26:00.867624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 136/281] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:00 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 27438 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:00.872387 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:00.873386 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:00.879953 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.880398 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.881168 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:00.881595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:00.969895 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d886a7aa-7dc9-409a-9683-e73c62595af8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 27394 microversion: 2.20 time: 0.101047 Jul 28 09:26:00.971230 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 137/282] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:00 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 27394 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:01.010583 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:01.018654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1dff6de1-849a-4a1c-a8e6-adbe3bba0d8d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.230725 Jul 28 09:26:01.019297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 146/283] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:00 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:01.714594 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:01.715450 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:01.722389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.722833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.723610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.724043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.738333 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:01.738979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:01.745049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.745519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.746458 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.746886 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.924043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:01.936854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:01.942522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-050cde1f-0b96-4f7b-b893-b5ff8a5254e1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.231920 Jul 28 09:26:01.943248 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 138/284] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:01 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:01.945387 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fd2b7d3a-dde2-4959-962f-cdf8ab2d900a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.211319 Jul 28 09:26:01.945956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 147/285] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:01 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:01.948415 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:01.949490 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:01.956283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.956800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.957724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.958219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.982554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:01.983516 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:01.989843 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.990291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:01.991063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:01.991490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:02.038075 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d91b8c62-6945-453d-bdb7-fb674bdfd835 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 27683 microversion: 2.1 time: 0.093230 Jul 28 09:26:02.038743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 139/286] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:01 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 27683 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:02.043521 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:02.044243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:02.050808 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:02.051258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:02.052052 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:02.052481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:02.070838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4401d629-ad4f-4212-badb-150697fe1fcd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 27596 microversion: 2.20 time: 0.091421 Jul 28 09:26:02.074838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 148/287] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:01 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 27596 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:02.176869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:02.184127 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-19b143e8-adf0-41c5-854a-ca6076923722 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.144238 Jul 28 09:26:02.184720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 140/288] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:02 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:02.960151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:02.960804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:02.961353 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:02.961966 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:02.967056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:02.967504 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:02.967685 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:02.968128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:02.968300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:02.968744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:02.968862 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:02.969293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.147039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:03.154644 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b7f02470-f359-4bee-abf0-94a2b56fa229 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.198508 Jul 28 09:26:03.155188 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:03.155318 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 149/289] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:02 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:03.159858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:03.161017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:03.164542 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-db255f6c-f7c0-4254-b206-fbaee6d5c2b1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.206639 Jul 28 09:26:03.165222 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 141/290] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:02 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:03.169946 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:03.170776 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:03.170935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.172024 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:03.172686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:03.173924 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.178970 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:03.179567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.180508 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:03.181064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.269625 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dc165b9d-ef4a-4707-b39f-1ce1c5ed157a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28066 microversion: 2.20 time: 0.102644 Jul 28 09:26:03.270265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 142/291] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:03 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28066 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:03.274689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8bc72d27-e946-450d-8166-69ba7429bebe tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 27849 microversion: 2.1 time: 0.118154 Jul 28 09:26:03.275196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:03.279379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 150/292] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:03 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 27849 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:03.279746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:03.283434 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:03.283993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.284760 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:03.285188 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:03.420694 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:03.427996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b0ca835b-2ae7-40d3-a42f-f872473cc770 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.156397 Jul 28 09:26:03.428556 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 143/293] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:03 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:04.018987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-813034c8-53e5-43e5-bade-14e4ab1bcc13 req-0934fc3f-eefc-402e-b89e-075cdef6a153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cf3764-aba2-4eae-aede-98a02e101b36", "name": "network-vif-plugged", "status": "completed", "tag": "1d9fa0e6-e536-4fd0-8183-daae01924304"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:04.020737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:26:04.020737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:26:04.028950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-813034c8-53e5-43e5-bade-14e4ab1bcc13 req-0934fc3f-eefc-402e-b89e-075cdef6a153 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.029477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-813034c8-53e5-43e5-bade-14e4ab1bcc13 req-0934fc3f-eefc-402e-b89e-075cdef6a153 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.041909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-813034c8-53e5-43e5-bade-14e4ab1bcc13 req-0934fc3f-eefc-402e-b89e-075cdef6a153 service nova] Creating event network-vif-plugged:1d9fa0e6-e536-4fd0-8183-daae01924304 for instance f5cf3764-aba2-4eae-aede-98a02e101b36 on hv-cinder-80266 Jul 28 09:26:04.047419 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-813034c8-53e5-43e5-bade-14e4ab1bcc13 req-0934fc3f-eefc-402e-b89e-075cdef6a153 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032917 Jul 28 09:26:04.048332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 151/294] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:26:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:04.171846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:04.172512 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:04.178817 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.179271 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.180089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.180526 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.183443 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:04.185870 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:04.195932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.196374 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.197338 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.197782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.427515 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:04.434422 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:04.437327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-77f5cd2f-ab34-4dbb-a11e-e9fa36d64109 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.269062 Jul 28 09:26:04.439913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 144/295] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:04 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:04.444621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:04.445821 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:04.451795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-66bb3cdb-db67-4053-8579-a71364b6e5ed tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.273558 Jul 28 09:26:04.451948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.452359 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.453355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 152/296] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:04 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:04.461648 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.462309 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.464578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:04.465514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:04.473753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.474373 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.475160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.475613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.545043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-839428bf-c3ab-43a3-b968-fa7a41e5dce2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28182 microversion: 2.20 time: 0.103700 Jul 28 09:26:04.546105 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 145/297] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:04 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28182 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:04.552949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:04.554431 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:04.555464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-64ac1ce0-a3b4-42cf-a68a-fb24dd4340ae tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28225 microversion: 2.1 time: 0.100539 Jul 28 09:26:04.556685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 153/298] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:04 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:04.562757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.563211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.564135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:04.564609 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:04.702543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:04.710742 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-252c102e-2ac2-4373-96c1-2719241d781d tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.163951 Jul 28 09:26:04.711303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 146/299] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:04 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:05.455288 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:05.456036 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.462560 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.463015 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.464147 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.464611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.469314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:05.470038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.476507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.477169 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.478148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.478590 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.666549 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:05.671523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:05.674925 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a554c5dd-485e-465f-8991-9cdfed70dafb tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1318 microversion: 2.1 time: 0.209452 Jul 28 09:26:05.675496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 147/300] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:05 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:05.680548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:05.681669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.684718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f89aa1b8-6753-40f6-9c73-154295879643 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1502 microversion: 2.1 time: 0.233867 Jul 28 09:26:05.685297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 154/301] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:05 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:05.688018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.688668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.689615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.690036 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:05.690165 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.691032 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.706065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.706605 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.707468 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.708004 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.819120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-faccd18c-f22d-49ad-8edd-dd6139def63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28225 microversion: 2.1 time: 0.132564 Jul 28 09:26:05.820108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 155/302] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:05 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:05.824108 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a02db685-f20f-4472-896d-536e5e3732f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28182 microversion: 2.20 time: 0.146960 Jul 28 09:26:05.825002 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 148/303] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:05 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28182 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:05.825699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35886065-2b21-40d9-b123-a808a11119f1"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:05.826840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.830717 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:05.831591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.834046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.834911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.835830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.836401 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.838046 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.838507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.839295 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.840332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.862619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] HTTP exception thrown: Cannot 'attach_volume' instance 722bacfd-c01b-427f-a5db-de2581b3dc2e while it is in vm_state rescued Jul 28 09:26:05.863203 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Returning 409 to user: Cannot 'attach_volume' instance 722bacfd-c01b-427f-a5db-de2581b3dc2e while it is in vm_state rescued {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:26:05.864243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2f0bbe55-bf4e-4555-b1f7-024cee0b23e5 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042533 Jul 28 09:26:05.864962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 156/304] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:26:05 2021] POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 09:26:05.874982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:05.875815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.882341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.882795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.883556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.884272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.954087 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9228547e-092d-4e32-ae80-a85a78cc6164 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action" status: 202 len: 0 microversion: 2.1 time: 0.083384 Jul 28 09:26:05.955234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 157/305] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:05 2021] POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:05.965431 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:05.967743 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:05.977730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.978484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.979343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:05.979950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:05.998807 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:06.006593 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a059f090-5d9d-4d6f-959f-3924922f1c31 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.179982 Jul 28 09:26:06.007155 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 149/306] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:05 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:06.074864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-1a030a32-1925-4158-b5c7-15c42bd8343a req-338e36e6-c342-4bcf-a6b9-ae537a57b1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2767cd35-0a35-4b78-9b72-107f31874ebb", "name": "network-vif-plugged", "status": "completed", "tag": "7b6afacf-2a40-45fe-bf93-2fd883badc12"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:06.076495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:26:06.076495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:26:06.089289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-1a030a32-1925-4158-b5c7-15c42bd8343a req-338e36e6-c342-4bcf-a6b9-ae537a57b1fb service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.090291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-1a030a32-1925-4158-b5c7-15c42bd8343a req-338e36e6-c342-4bcf-a6b9-ae537a57b1fb service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:06.106846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-1a030a32-1925-4158-b5c7-15c42bd8343a req-338e36e6-c342-4bcf-a6b9-ae537a57b1fb service nova] Creating event network-vif-plugged:7b6afacf-2a40-45fe-bf93-2fd883badc12 for instance 2767cd35-0a35-4b78-9b72-107f31874ebb on hv-cinder-80266 Jul 28 09:26:06.112102 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-1a030a32-1925-4158-b5c7-15c42bd8343a req-338e36e6-c342-4bcf-a6b9-ae537a57b1fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043740 Jul 28 09:26:06.113360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 150/307] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:26:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:06.199260 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:06.208324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a2571fa0-be38-46f0-9263-9721db2ba776 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1510 microversion: 2.1 time: 0.248762 Jul 28 09:26:06.209356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 158/308] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:05 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:06.694929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:06.695669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:06.702692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.703446 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:06.704632 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.705330 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:06.836594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:06.836594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:06.841198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.841653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:06.842881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.843686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:06.939950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2f86a492-e893-4ae0-a963-77d0a2d4e313 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28516 microversion: 2.1 time: 0.111779 Jul 28 09:26:06.940519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 159/309] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:06 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28516 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:06.947366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:06.949050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:06.957980 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.958667 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:06.959468 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:06.959939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:07.049769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c7e027f6-2950-4f9a-a90d-24105f89081e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28473 microversion: 2.20 time: 0.106753 Jul 28 09:26:07.054398 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 160/310] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:06 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28473 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:07.061085 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:07.062299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:07.070815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:07.071259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:07.072329 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:07.072948 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:07.245596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:07.262429 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-60e393b7-d969-4d4a-8a2f-e52e5e3f37f9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1507 microversion: 2.1 time: 0.571872 Jul 28 09:26:07.265606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 151/311] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:06 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:07.283017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:07.283785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:07.291241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:07.292027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:07.293878 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:07.294530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:07.327363 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:07.336766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-97bbcc84-9a80-43ec-97f3-3438f3a6b1e1 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1314 microversion: 2.1 time: 0.280249 Jul 28 09:26:07.337333 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 161/312] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:07 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:07.436385 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:07.445248 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bec6f3de-2aaa-4c26-87c7-c6496339de5b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1510 microversion: 2.1 time: 0.166578 Jul 28 09:26:07.446103 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 152/313] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:07 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:07.953342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:07.958915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:07.965603 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:07.966394 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:07.967246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:07.967923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.062361 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:08.064011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:08.065433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d2fdcf1a-13b1-4af6-b152-373bd41423d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28516 microversion: 2.1 time: 0.116865 Jul 28 09:26:08.067643 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 162/314] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:07 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28516 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:08.071224 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.071952 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.076257 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.076679 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.170074 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-61444915-9e75-4125-8bcb-a75606448509 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28594 microversion: 2.20 time: 0.111758 Jul 28 09:26:08.174871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 153/315] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:08 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28594 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:08.354194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:08.354899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:08.364534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.365281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.366118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.366752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.465881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:08.467375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:08.475783 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.476298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.477136 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.477688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.508027 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:08.517969 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-97740b20-9eca-4fec-b030-dc6c3427b241 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1499 microversion: 2.1 time: 0.167515 Jul 28 09:26:08.518688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 163/316] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:08 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:08.627464 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:08.645105 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-779fc775-e28d-446d-b1bf-284561bfa955 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1510 microversion: 2.1 time: 0.184473 Jul 28 09:26:08.645809 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 154/317] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:08 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:08.704863 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "914a21d2-dd11-46c5-8e02-86a5ea5fc5b9"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:08.706741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:08.712889 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.713328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:08.714100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:08.714533 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.037781 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2d9e7cbf-de7c-4909-9931-f2928ce98acd tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336781 Jul 28 09:26:09.039165 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 164/318] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:26:08 2021] POST /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:09.084877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:09.086676 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:09.096029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.096903 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.097926 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.098468 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.185031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:09.186614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:09.190000 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9f25bef5-a5d1-4383-a1fa-9a9ecffc8403 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28682 microversion: 2.1 time: 0.110848 Jul 28 09:26:09.191039 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 155/319] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:09 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28682 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:09.196393 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:09.196982 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:09.197347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.198170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.199169 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.199836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.209037 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.209727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.212824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.213291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.254014 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:26:09.286273 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7c8045c9-a226-43df-a383-3eefcf809554 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28639 microversion: 2.20 time: 0.107073 Jul 28 09:26:09.287775 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 165/320] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:09 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28639 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:09.496762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a3353a78-dbc5-4942-a976-16d1adf15001 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 204 len: 0 microversion: 2.1 time: 0.303673 Jul 28 09:26:09.497803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 156/321] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:26:09 2021] DELETE /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:26:09.508371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:09.509200 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:09.515995 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.516347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.517840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.518461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.663126 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:09.663854 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:09.670110 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.671405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.671933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:09.673288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:09.673948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:09.679967 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d8341114-17b0-475a-912b-e4661f5f6010 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1505 microversion: 2.1 time: 0.176188 Jul 28 09:26:09.680541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 166/322] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:09 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:09.814438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:09.821704 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2b9711bc-567c-4f30-b8d7-8e7c867ca980 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1510 microversion: 2.1 time: 0.163023 Jul 28 09:26:09.822251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 157/323] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:09 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:10.210343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:10.211236 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:10.217881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.218329 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.219432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.220504 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.298625 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:10.299562 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:10.306274 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.306719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.307515 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.307986 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.316111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9ccdb3fb-ac93-451f-95c9-98f1d9139fcc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28682 microversion: 2.1 time: 0.116969 Jul 28 09:26:10.316795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 167/324] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:10 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28682 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:10.411235 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7756b8ae-baa5-4a30-96b5-1b51c989111e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28639 microversion: 2.20 time: 0.116526 Jul 28 09:26:10.415098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 158/325] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:10 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28639 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:10.699067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:10.699803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:10.709367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.709820 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.710802 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.711245 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.844575 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:10.847064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:10.862525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.863388 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.864988 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:10.865657 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:10.878368 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:10.887742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-beb16e25-a32f-44a1-b060-8234cbdd2a9e tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1505 microversion: 2.1 time: 0.193377 Jul 28 09:26:10.889129 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 168/326] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:10 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:11.328125 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:11.329598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:11.336141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:11.336806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:11.338297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:11.338937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:11.440107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-42f65aa5-6c77-4422-aa62-68cfacc51b73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28682 microversion: 2.1 time: 0.115227 Jul 28 09:26:11.440849 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 169/327] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:11 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28682 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:11.447221 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:11.448508 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:11.456179 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:11.459232 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:11.459980 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:11.460989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:11.461806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:11.469968 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a0d16335-379f-46ea-a762-93ed27ae8c53 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1516 microversion: 2.1 time: 0.632586 Jul 28 09:26:11.480296 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 159/328] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:10 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1516 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:11.602641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6309d8bc-f3aa-4a64-b954-ec0d427074de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28639 microversion: 2.20 time: 0.159986 Jul 28 09:26:11.603814 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 170/329] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:11 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28639 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:11.905688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:11.906621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:11.914732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:11.915688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:11.916789 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:11.917490 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.265056 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:12.273679 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-47310b98-a2eb-444f-872d-fe8db14f83f9 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1505 microversion: 2.1 time: 0.372068 Jul 28 09:26:12.274318 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 160/330] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:11 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:12.458438 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:12.459640 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:12.476404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.476857 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.477821 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.478255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.580146 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-535ac5d2-8b72-41db-832f-d06cd403b52a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28682 microversion: 2.1 time: 0.130034 Jul 28 09:26:12.585167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 171/331] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:12 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28682 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:12.617443 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:12.618385 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:12.633007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.633463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.634255 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.634684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.718253 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-c730c9b2-8ba5-4fe6-ae57-a07b73750e72 req-2ffc5cb2-bf09-4880-936c-fecb608fd4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2767cd35-0a35-4b78-9b72-107f31874ebb", "name": "network-vif-deleted", "tag": "7b6afacf-2a40-45fe-bf93-2fd883badc12"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:12.723086 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:26:12.723086 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:26:12.735331 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c730c9b2-8ba5-4fe6-ae57-a07b73750e72 req-2ffc5cb2-bf09-4880-936c-fecb608fd4b0 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.740089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c730c9b2-8ba5-4fe6-ae57-a07b73750e72 req-2ffc5cb2-bf09-4880-936c-fecb608fd4b0 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.744773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ce7cdb0d-4c3d-4020-836c-6142544ff8ba tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28639 microversion: 2.20 time: 0.131277 Jul 28 09:26:12.746609 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 161/332] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:12 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28639 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:12.762136 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-c730c9b2-8ba5-4fe6-ae57-a07b73750e72 req-2ffc5cb2-bf09-4880-936c-fecb608fd4b0 service nova] Creating event network-vif-deleted:7b6afacf-2a40-45fe-bf93-2fd883badc12 for instance 2767cd35-0a35-4b78-9b72-107f31874ebb on hv-cinder-80266 Jul 28 09:26:12.770842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-c730c9b2-8ba5-4fe6-ae57-a07b73750e72 req-2ffc5cb2-bf09-4880-936c-fecb608fd4b0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060993 Jul 28 09:26:12.771958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 172/333] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:26:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:26:12.970786 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:12.971646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:12.979104 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.979554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:12.980375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:12.980816 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.238610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:13.248579 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6e310dca-42f4-4d70-8a54-d5278d3df4a3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1516 microversion: 2.1 time: 0.283051 Jul 28 09:26:13.249399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 162/334] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:12 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:13.268545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60513e0f-a321-430f-857a-bcb3a2c81814"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:13.269958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:13.277217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.278097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.279034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.279632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.292010 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:13.292788 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:13.301607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.302241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.303153 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.304283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.349094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.349709 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.351204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lazy-loading 'fault' on Instance uuid 2767cd35-0a35-4b78-9b72-107f31874ebb {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:26:13.530813 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4dc3f1239854ea0b7e24ec53c7862f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e37808f2054fe2b42ec96a381300c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:13.545829 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0de2ab5c-392a-4771-bf21-040ac54fcc53 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 200 len: 1304 microversion: 2.1 time: 0.255430 Jul 28 09:26:13.548964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 163/335] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:13 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 1304 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:13.592149 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:13.593136 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:13.603616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.605178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.606218 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.607453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.688535 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-846e5d73-f1b1-4ec0-ad1d-a89ef233f873 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28682 microversion: 2.1 time: 0.100051 Jul 28 09:26:13.694660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 164/336] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:13 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28682 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:13.759367 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:13.760430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:13.778114 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.780037 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.781432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:13.783495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:13.877787 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b81e4270-2cbd-4c34-a576-fd6b27030250 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.612014 Jul 28 09:26:13.879257 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 173/337] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:26:13 2021] POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:13.887526 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dc9734a0-af24-45a6-b468-7e1c81fc2db0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28639 microversion: 2.20 time: 0.131994 Jul 28 09:26:13.888211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 165/338] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:13 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28639 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:14.565985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:14.567076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] [instance: 2767cd35-0a35-4b78-9b72-107f31874ebb] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:14.588058 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:14.588433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:14.589336 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:14.589812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:14.621351 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] HTTP exception thrown: Instance 2767cd35-0a35-4b78-9b72-107f31874ebb could not be found. Jul 28 09:26:14.622391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] Returning 404 to user: Instance 2767cd35-0a35-4b78-9b72-107f31874ebb could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:26:14.623446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-18c2a221-85cc-44cd-b248-2fc11fd52117 tempest-VolumesActionsTest-1610264106 tempest-VolumesActionsTest-1610264106-project] 10.222.0.23 "GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb" status: 404 len: 111 microversion: 2.1 time: 0.062284 Jul 28 09:26:14.630377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 174/339] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:14 2021] GET /compute/v2.1/servers/2767cd35-0a35-4b78-9b72-107f31874ebb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:26:14.705085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:14.706654 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:14.720246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:14.721773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:14.725830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:14.726457 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:14.834285 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6d7fca17-ece2-4b74-914e-ef79b2bfc63b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28682 microversion: 2.1 time: 0.131386 Jul 28 09:26:14.835186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 166/340] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:14 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28682 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:14.898674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:14.900470 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:14.907188 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:14.922729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:14.925805 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:14.926831 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:15.040099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2cb6413d-fe9f-441c-9e6b-9c6546bbf630 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 28639 microversion: 2.20 time: 0.144881 Jul 28 09:26:15.046754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 175/341] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:14 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 28639 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:15.849516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:15.853310 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:15.875493 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:15.876227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:15.877025 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:15.877453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:15.971042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1f73ed80-0f26-4bfa-aa9e-8780297ae03d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 28949 microversion: 2.1 time: 0.127432 Jul 28 09:26:15.972070 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 167/342] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:15 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 28949 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:16.057279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:16.058766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:16.067551 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:16.068034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:16.069074 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:16.069519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:16.863881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "914a21d2-dd11-46c5-8e02-86a5ea5fc5b9"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:16.865057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:16.881595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:16.882420 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:16.884013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:16.900904 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:17.044666 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] HTTP exception thrown: Invalid volume: volume 914a21d2-dd11-46c5-8e02-86a5ea5fc5b9 is already attached to instances: f5cf3764-aba2-4eae-aede-98a02e101b36 Jul 28 09:26:17.045461 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Returning 400 to user: Invalid volume: volume 914a21d2-dd11-46c5-8e02-86a5ea5fc5b9 is already attached to instances: f5cf3764-aba2-4eae-aede-98a02e101b36 {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:26:17.046466 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fcfe6f37-a6b6-4a5a-b724-3e6672ac3e95 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187486 Jul 28 09:26:17.047178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 168/343] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:26:16 2021] POST /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 09:26:17.059887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:17.061347 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:17.068602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:17.069034 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:17.069971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:17.070697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:19.186371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d9782534-e143-4308-801d-c4af36f93ec0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 31560 microversion: 2.20 time: 3.134602 Jul 28 09:26:19.187456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 176/344] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:16 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 31560 bytes in 3137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:19.198400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:19.199012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8f5b8d4d-1455-4d24-8a26-0039623bee62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 31083 microversion: 2.1 time: 2.149799 Jul 28 09:26:19.199508 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:19.199723 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 169/345] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:17 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 31083 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:19.217893 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:19.218345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:19.222835 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:19.223292 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:19.415561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lazy-loading 'services' on Instance uuid f5cf3764-aba2-4eae-aede-98a02e101b36 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:26:19.883050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f021059c-bde7-45fa-909d-9b8f745805aa tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36/os-volume_attachments/914a21d2-dd11-46c5-8e02-86a5ea5fc5b9" status: 202 len: 0 microversion: 2.1 time: 0.693923 Jul 28 09:26:19.883683 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 177/346] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:26:19 2021] DELETE /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36/os-volume_attachments/914a21d2-dd11-46c5-8e02-86a5ea5fc5b9 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:20.200826 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:20.202577 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:20.214473 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:20.216578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:20.220188 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:20.220649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:20.221950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:20.222396 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:20.228226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:20.228933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:20.229904 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:20.237195 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:20.334643 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3c2c5e73-ed46-4e95-b589-49d9695e8da7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 32372 microversion: 2.20 time: 0.137923 Jul 28 09:26:20.335309 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 170/347] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:20 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 32372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:20.347162 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-634484f0-eee7-43bf-8277-21db5f2ec359 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 32074 microversion: 2.1 time: 0.138664 Jul 28 09:26:20.348393 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 178/348] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:20 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 32074 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:21.350897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:21.352131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:21.360565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:21.362487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:21.371761 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:21.372425 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:21.373290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:21.373737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:21.375034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:21.376628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:21.380623 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:21.381312 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:21.502881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a4809f52-c0e7-4789-a3fd-338cf9db6d92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 33222 microversion: 2.20 time: 0.159373 Jul 28 09:26:21.503945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 171/349] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:21 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 33222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:21.533715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2275ca8f-5bd0-4b0d-8814-8e5b6c272be9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 32986 microversion: 2.1 time: 0.174621 Jul 28 09:26:21.535049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 179/350] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:21 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 32986 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:22.514906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:22.517749 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:22.546214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:22.547999 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:22.552180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:22.552688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:22.553532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:22.553974 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:22.567909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:22.574352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:22.576642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:22.590945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:22.691270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-769d3ffd-acc5-441c-801d-e0c376519836 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 33721 microversion: 2.20 time: 0.180132 Jul 28 09:26:22.697266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e8d55035-0247-48cc-aefb-5d11f47822e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 33470 microversion: 2.1 time: 0.154614 Jul 28 09:26:22.700357 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 180/351] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:22 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 33470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:22.700843 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 172/352] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:22 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 33721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:23.333292 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d7af11c6-03d0-4efe-bc6b-f09ee4c054f7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Action: 'create', calling method: .version_select at 0x7f16d0f110d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1580493964"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:23.395024 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-d7af11c6-03d0-4efe-bc6b-f09ee4c054f7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Getting quotas for project b0bed69fc98347318765653ba412b638. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:26:23.399858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-d7af11c6-03d0-4efe-bc6b-f09ee4c054f7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Getting quotas for user d4a864435ca04f7189db015e7823ab88 and project b0bed69fc98347318765653ba412b638. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:26:23.716451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:23.718736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:23.728143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:23.728851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:23.729932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:23.730524 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:23.824190 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ee1e9528-df23-4a43-8aa8-12dc5800367e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 33940 microversion: 2.1 time: 0.115540 Jul 28 09:26:23.825708 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 173/353] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:23 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 33940 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:23.849125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:23.850676 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:23.880050 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:23.880635 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:23.881557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:23.882022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:23.992166 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-688e63d9-a001-4633-9911-78527a07ae87 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 35602 microversion: 2.20 time: 0.163801 Jul 28 09:26:23.992928 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 174/354] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:23 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 35602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:24.011300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-d7af11c6-03d0-4efe-bc6b-f09ee4c054f7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Getting quotas for project b0bed69fc98347318765653ba412b638. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:26:24.016777 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-d7af11c6-03d0-4efe-bc6b-f09ee4c054f7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Getting quotas for user d4a864435ca04f7189db015e7823ab88 and project b0bed69fc98347318765653ba412b638. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:26:24.051684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d7af11c6-03d0-4efe-bc6b-f09ee4c054f7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.972318 Jul 28 09:26:24.053673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 181/355] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jul 28 09:26:23 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:24.877590 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:24.878579 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:24.893380 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:24.893846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:24.894662 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:24.895103 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:25.005599 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:25.007601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:25.017662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:25.019473 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:25.020536 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:25.021237 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:25.037055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6b4e0c18-f1a5-4108-83d5-1e103795428c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 34697 microversion: 2.1 time: 0.192152 Jul 28 09:26:25.038164 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 175/356] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:24 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 34697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:25.136767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-47977835-fad2-4afe-8fa2-5f6466057651 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 36151 microversion: 2.20 time: 0.136229 Jul 28 09:26:25.137738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 182/357] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:24 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 36151 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:26.050309 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:26.051391 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:26.064852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.065310 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.066109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.066545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.149428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:26.151195 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:26.162261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.162261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.162953 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.165758 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.177951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a4e65d19-a6d3-49dc-a812-87e5b20cfd12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 35280 microversion: 2.1 time: 0.132145 Jul 28 09:26:26.182141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 176/358] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:26 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 35280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:26.287161 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-17901f8e-e898-491d-addc-44ef9a326e97 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 36693 microversion: 2.20 time: 0.141525 Jul 28 09:26:26.287949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 183/359] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:26 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 36693 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:26.414778 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:26.415848 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:26.431715 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.432074 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.432939 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.433438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.486773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lazy-loading 'flavor' on Instance uuid 722bacfd-c01b-427f-a5db-de2581b3dc2e {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:26:26.728112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6a2fd4e4-5862-4ae0-8d44-21e7684360e9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action" status: 200 len: 32 microversion: 2.1 time: 0.317360 Jul 28 09:26:26.729264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 177/360] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:26 2021] POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action => generated 32 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:26:26.743545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:26.744222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:26.756832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.757704 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:26.758715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:26.759415 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:27.058681 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:27.089052 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fd44dd96-9377-4bfe-aace-9aa9ea40bbad tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.353480 Jul 28 09:26:27.095919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 184/361] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:26 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:27.205796 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:27.207128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:27.224543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:27.225211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:27.232151 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:27.232847 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:27.302503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:27.304577 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:27.319237 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:27.320005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:27.321875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:27.323691 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:27.331851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-25475642-3404-40ac-996b-cce0545dd5bc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 35824 microversion: 2.1 time: 0.144278 Jul 28 09:26:27.337695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 178/362] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:27 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 35824 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:27.439428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-02dfb631-b3c1-46a6-a6ec-c2613954272f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 37896 microversion: 2.20 time: 0.144656 Jul 28 09:26:27.440194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 185/363] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:27 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 37896 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:27.900887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-572658367", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "3463c92e-9592-4a5e-be73-c0318bba2428"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:28.108769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:28.110559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:28.117660 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:28.118109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:28.118901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:28.119378 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:28.281225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:28.292765 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bccc8365-16c3-4642-a1c6-9169a8d7b865 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.187986 Jul 28 09:26:28.293739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 186/364] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:28 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:28.350419 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:28.352377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:28.360594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:28.362153 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:28.363661 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:28.364462 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:28.464320 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0a96b72d-0cab-4e09-9ccd-cfa8dfef7f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 36589 microversion: 2.1 time: 0.116577 Jul 28 09:26:28.470108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 187/365] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:28 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 36589 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:28.476077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:28.477178 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:28.485855 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:28.486608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:28.487662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:28.488291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:28.590887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2b9e9e64-59f0-4f95-9c15-57786090f6c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 38134 microversion: 2.20 time: 0.118671 Jul 28 09:26:28.591845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 188/366] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:28 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 38134 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:29.310633 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:29.311444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:29.318792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:29.319352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:29.320254 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:29.320748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:29.454840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:29.464498 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2ced9977-abf5-418a-903a-710756f9af16 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.157850 Jul 28 09:26:29.465154 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 189/367] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:29 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:29.480212 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:29.481235 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:29.488427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:29.488974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:29.489738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:29.490164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:29.584423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a10541c9-61e6-4866-bb58-fabd17c9f426 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 37242 microversion: 2.1 time: 0.108009 Jul 28 09:26:29.585868 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 190/368] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:29 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 37242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:26:29.602878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:29.603963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:29.611350 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:29.611817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:29.612613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:29.613052 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:29.685436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-befc7a23-6c9d-4fb1-8fe4-4a03bdd7fc5e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 38134 microversion: 2.20 time: 0.086480 Jul 28 09:26:29.686333 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 191/369] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:29 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 38134 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:30.482596 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:30.483315 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:30.490317 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:30.491014 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:30.492047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:30.492657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:30.630648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:30.640684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e99d9b30-1073-46c5-922d-11918095ef8e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.162037 Jul 28 09:26:30.650426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 192/370] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:30 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:30.650426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:30.650426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:30.658202 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:30.658654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:30.659493 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:30.660313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:30.762045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-627a0c33-f9ce-480a-97d7-5661809801e5 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 37944 microversion: 2.1 time: 0.118634 Jul 28 09:26:30.763045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 193/371] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:30 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 37944 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:30.768888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:30.770007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:30.783488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:30.783962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:30.785238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:30.785687 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:30.864787 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-659f19ce-827c-4d82-a7c0-298d153b84af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 38134 microversion: 2.20 time: 0.100566 Jul 28 09:26:30.866078 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 194/372] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:30 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 38134 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:31.659417 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:31.660907 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:31.667500 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:31.667980 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:31.668931 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:31.669545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.160986 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:32.169528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4eb17888-16c9-48cd-ac2d-68f5e3a2fd01 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.515012 Jul 28 09:26:32.180933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 195/373] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:31 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:32.186090 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:32.187405 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:32.202741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.205806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.206881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.207540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.285569 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9d98650f-14e2-43ad-93ec-b4306d92a7e8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 200 len: 38286 microversion: 2.1 time: 0.103048 Jul 28 09:26:32.287665 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 196/374] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:32 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 38286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:32.293741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:32.295202 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:32.304324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.305265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.306552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.307545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.386729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-47cea626-c32a-4b1b-9c5d-c3b8d2ea9ece tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 200 len: 38275 microversion: 2.20 time: 0.097389 Jul 28 09:26:32.388877 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 197/375] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:32 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 38275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:26:32.395157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:32.396027 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:32.411756 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.412358 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.413270 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.413977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.444213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e9569789-966e-4880-aa4a-8186ce61be3f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/ips" status: 200 len: 147 microversion: 2.1 time: 0.054127 Jul 28 09:26:32.459985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 198/376] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Jul 28 09:26:32 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/ips => generated 147 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:32.465594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:32.466411 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:32.474048 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.474586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.475442 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:32.475978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:32.509515 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fbe72619-4098-4335-af25-a8763241fe01 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/ips" status: 200 len: 152 microversion: 2.20 time: 0.047683 Jul 28 09:26:32.510048 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 199/377] 10.222.0.23 () {60 vars in 1289 bytes} [Wed Jul 28 09:26:32 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:26:33.189552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:33.189552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:33.197645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:33.198097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:33.198879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:33.199313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:33.358139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:33.366798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8a5c5c41-c049-4a6f-b781-3fb58065d94b tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.184353 Jul 28 09:26:33.367342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 200/378] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:33 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:34.385303 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:34.385919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:34.392699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:34.393143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:34.393917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:34.394346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:34.533078 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:34.541665 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cd28c789-2bc2-4ced-bb1d-1c79af78552e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.160036 Jul 28 09:26:34.542223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 201/379] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:34 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:34.968818 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:34.969426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:34.975331 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:34.975816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:34.976586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:34.977489 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:35.004179 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lazy-loading 'flavor' on Instance uuid 1770556b-7187-418c-9c5e-6f6652a8f4c3 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:26:47.612703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] validate_networks() for [('3463c92e-9592-4a5e-be73-c0318bba2428', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:26:47.868247 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e672f3cb-2139-4204-93bb-27cc5bdb3b21 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 202 len: 0 microversion: 2.20 time: 12.902501 Jul 28 09:26:47.869539 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 202/380] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:26:34 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 0 bytes in 12906 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:26:47.878909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a980c029-1fd3-4e46-9827-5ce49fc10553"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:47.880757 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:47.894400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:47.894944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:47.895878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:47.896659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.014464 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:26:48.015457 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:26:48.015963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:26:48.016495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:26:48.016911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:26:48.032996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:48.033719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.034747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:48.035249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.052527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:26:48.057298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Getting quotas for user 56058a59ffca404ba8121aae6e09ce3b and project 3ffc9329f42c48d5a02f450469dbaf89. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:26:48.069747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:26:48.072283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:26:48.123049 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-677fcca7-403a-4868-adbb-daded213812b tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 20.226321 Jul 28 09:26:48.123741 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 179/381] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:26:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 20228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:26:48.129200 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:48.129618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:48.136282 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:48.136728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.137500 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:48.137932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.268436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:48.276354 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-142140d2-1c41-40b2-976f-b95270c3759e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.150984 Jul 28 09:26:48.277031 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 180/382] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:48 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:48.281644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:48.282314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:48.288106 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:48.288571 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.289408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:48.289911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:48.422429 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:48.430793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:48.432654 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:48.433881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4cff2bc8-84c9-4cb2-b204-f819ce92e4b4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.155554 Jul 28 09:26:48.434551 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 181/383] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:48 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:26:48.439826 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-327eb185-2801-4df0-a419-e13e757af5de tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:48.440462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-327eb185-2801-4df0-a419-e13e757af5de tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:48.493552 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-327eb185-2801-4df0-a419-e13e757af5de tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:48.500951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-327eb185-2801-4df0-a419-e13e757af5de tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1217 microversion: 2.1 time: 0.065394 Jul 28 09:26:48.501522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 182/384] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:48 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:49.298891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:49.299561 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:49.305364 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:49.305805 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:49.306559 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:49.306987 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:49.442572 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:49.451004 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5e9a189a-49bc-4a99-8089-c48c8d787d40 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.155896 Jul 28 09:26:49.451605 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 183/385] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:49 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:49.456839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:49.457439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:49.463086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:49.463529 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:49.464312 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:49.464742 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:49.596121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:49.604813 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:49.607184 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:49.609251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f055d58b-8ef0-4e5f-af8d-200e26bd7903 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.155756 Jul 28 09:26:49.610251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 184/386] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:49 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:26:49.614589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:49.615248 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:49.621115 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:49.621569 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:49.622343 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:49.622818 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:49.683641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:49.691616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-817bf404-5605-46ad-baf9-a3ce98e12aab tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1221 microversion: 2.1 time: 0.080348 Jul 28 09:26:49.692179 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 185/387] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:49 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:50.358835 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-39e86d14-5096-4ee8-a262-1a3446f29bbb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.486614 Jul 28 09:26:50.377772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 203/388] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:26:47 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/os-volume_attachments => generated 194 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:26:50.469138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:50.469757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:50.487376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:50.488105 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:50.490674 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:50.491123 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:50.629553 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:50.630718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:50.639699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:50.640426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:50.641423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:50.642558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:51.003428 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:51.031409 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5ccc8839-d073-4a6a-9b72-3749b1a9336e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.559655 Jul 28 09:26:51.034406 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 186/389] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:50 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:51.065174 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:51.067223 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:51.089238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:51.089981 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:51.091065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:51.092097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:51.235782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:51.249790 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-16b47e77-ae1e-40c7-a1b3-14c49d7f77d9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1287 microversion: 2.1 time: 0.201766 Jul 28 09:26:51.251517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 187/390] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:51 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:51.269248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:51.278567 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:51.280936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:51.282381 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d3dbd95c-1dd0-42cd-a474-d1820fbec5b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.657827 Jul 28 09:26:51.293282 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 204/391] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:50 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:26:52.050823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:52.051378 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:52.057274 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:52.057719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:52.058484 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:52.058916 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:52.179023 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:52.187636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-db6862c5-9288-4e1c-9de5-cd58882ce7b1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.140486 Jul 28 09:26:52.188421 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 188/392] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:52 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:52.266863 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:52.267609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:52.273602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:52.274045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:52.274804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:52.275229 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:52.300249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:52.300945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:52.306672 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:52.307118 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:52.307917 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:52.308352 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:52.425081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:52.432631 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-13884d6a-0502-491c-b4dc-f61fa15c6da1 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.170054 Jul 28 09:26:52.433191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 205/393] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:52 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:52.472981 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:52.481381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:52.482894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:52.484255 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-79006b3b-7948-40f4-9ce6-6de7a4b729db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.187691 Jul 28 09:26:52.484803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 189/394] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:52 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:26:53.205047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:53.205657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:53.211822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:53.212114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:53.212876 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:53.213301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:53.332445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:53.340110 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-35dce622-7810-4ff5-91fd-4705370bf257 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.138869 Jul 28 09:26:53.340665 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 206/395] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:53 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:53.450636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:53.451249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:53.457560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:53.458009 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:53.458764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:53.459199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:53.502280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:53.502893 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:53.508608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:53.509059 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:53.509831 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:53.510270 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:53.610290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:53.618401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-73b4420b-eca1-4904-b7b3-53a4bd97ca03 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.171366 Jul 28 09:26:53.619052 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 190/396] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:53 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:53.658565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:53.666426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:53.668005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:53.669145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-aa96a8a8-4603-4fe4-a85c-535fa6f22f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.170773 Jul 28 09:26:53.669689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 207/397] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:53 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:26:54.357516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:54.358660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:54.364503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:54.364951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:54.365713 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:54.366145 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:54.485857 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:54.493539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9892fa86-65bc-4647-b030-d55e2f81de32 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.139734 Jul 28 09:26:54.494098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 191/398] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:54 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:54.635338 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:54.635984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:54.642866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:54.643319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:54.644123 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:54.644564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:54.687265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:54.687910 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:54.693914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:54.694626 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:54.695285 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:54.695715 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:54.854993 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:54.867956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6479e66f-fa9b-4de9-af90-67303f27ea64 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.236114 Jul 28 09:26:54.868839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 208/399] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:54 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:54.924934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:54.936269 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:54.938658 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:54.939962 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c29b4153-9a61-47f7-beea-f11fd79785cf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.256804 Jul 28 09:26:54.943876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 192/400] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:54 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:26:55.489272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-8f1c785b-82bd-4e0c-a850-d2535f21eaac req-0ea388e8-d6e7-44a3-8cb0-5085c8816d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a2647e-a9b0-45df-a370-c027a06a66c0", "tag": "b6472eff-77ac-4376-8a00-5243d63b6c05"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:55.491193 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:26:55.491193 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:26:55.498399 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8f1c785b-82bd-4e0c-a850-d2535f21eaac req-0ea388e8-d6e7-44a3-8cb0-5085c8816d65 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.498890 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8f1c785b-82bd-4e0c-a850-d2535f21eaac req-0ea388e8-d6e7-44a3-8cb0-5085c8816d65 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:55.511849 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:55.513295 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:55.519328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-8f1c785b-82bd-4e0c-a850-d2535f21eaac req-0ea388e8-d6e7-44a3-8cb0-5085c8816d65 service nova] Creating event network-changed:b6472eff-77ac-4376-8a00-5243d63b6c05 for instance 32a2647e-a9b0-45df-a370-c027a06a66c0 on hv-cinder-80266 Jul 28 09:26:55.521525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.522659 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:55.523314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.524124 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:55.524347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-8f1c785b-82bd-4e0c-a850-d2535f21eaac req-0ea388e8-d6e7-44a3-8cb0-5085c8816d65 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038658 Jul 28 09:26:55.524937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 209/401] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:26:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:26:55.721042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:55.729129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e8c82e50-5a3f-43b6-b3e8-212dd3fecdab tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.222128 Jul 28 09:26:55.729703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 193/402] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:55 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:26:55.885739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:55.886437 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:55.893513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.893960 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:55.894926 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.895351 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:55.959175 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:55.960033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:55.967302 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.968129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:55.969183 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:55.969610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:56.091233 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:56.099952 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-31a363a7-9ac8-4f9b-b88a-876104573bae tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.218073 Jul 28 09:26:56.100538 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 210/403] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:55 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:56.175117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:56.190057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:56.199182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:56.200587 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3ff8c9ee-e962-4c85-8cee-4e016a7cf2ca tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.245437 Jul 28 09:26:56.212215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 194/404] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:55 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:26:56.746243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:56.747164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:56.756994 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:56.758265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:56.759234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:56.759832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:56.997987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:57.010594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e3169672-100c-476c-b62b-66295642a853 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.267934 Jul 28 09:26:57.011129 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 211/405] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:56 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:57.116888 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:57.117506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:57.123938 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:57.124487 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:57.125542 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:57.126008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:57.219619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:57.220472 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:57.227216 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:57.227705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:57.230073 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:57.230527 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:57.264016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:57.273344 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a26cf4fc-d57e-4a7e-86a1-82f7301614d7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.160201 Jul 28 09:26:57.274390 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 195/406] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:57 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:57.367822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:57.376629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:57.378238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:57.379439 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8a4296d2-c5be-457d-9bde-c68dc877e1d5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.164675 Jul 28 09:26:57.380091 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 212/407] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:57 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:26:57.504996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2115556405", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1580493964", "security_groups": [{"name": "tempest-secgroup-smoke-1968132956"}], "networks": [{"uuid": "1a784077-0c76-428e-b683-1275b4c6c8ec"}], "block_device_mapping_v2": [{"uuid": "ee76ff36-04ca-421c-8bd2-d6022f7a0494", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:57.610849 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] validate_networks() for [('1a784077-0c76-428e-b683-1275b4c6c8ec', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:26:57.943882 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fd9fd9a5-5628-4834-b7a7-e4ae0b2f7859 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:26:57.951225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd9fd9a5-5628-4834-b7a7-e4ae0b2f7859 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:57.951820 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd9fd9a5-5628-4834-b7a7-e4ae0b2f7859 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.014979 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:26:58.015459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:26:58.016308 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:26:58.016768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:26:58.017276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:26:58.019946 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fd9fd9a5-5628-4834-b7a7-e4ae0b2f7859 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Going to try to stop instance {{(pid=107293) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 28 09:26:58.026537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.026993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.028141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.028579 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.047703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Getting quotas for project b0bed69fc98347318765653ba412b638. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:26:58.051877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Getting quotas for user d4a864435ca04f7189db015e7823ab88 and project b0bed69fc98347318765653ba412b638. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:26:58.075916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fd9fd9a5-5628-4834-b7a7-e4ae0b2f7859 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 202 len: 0 microversion: 2.1 time: 0.135918 Jul 28 09:26:58.081754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 213/408] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:26:57 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:26:58.085712 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:58.086801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:58.096168 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.096715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.097513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.097979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.127644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:26:58.129766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee76ff36-04ca-421c-8bd2-d6022f7a0494',volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:26:58.291541 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0f8bff79-e03b-4153-8ecf-f6ab49804e55 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.790241 Jul 28 09:26:58.298580 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 196/409] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:26:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:26:58.300954 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.307016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:58.307016 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:58.310304 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-27944b6b-84b3-4064-8ac1-03f8ba60ec3e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.229753 Jul 28 09:26:58.310883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 214/410] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:58 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:58.317281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:58.317890 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:58.324033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.324590 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.325624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.326201 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.326964 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.327659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.328527 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.328972 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.657621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.666965 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8344ccdb-09d4-492c-bcdb-c1faec27fbaf tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.354430 Jul 28 09:26:58.668296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 215/411] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:58 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:58.675248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:58.676160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:58.683101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.684015 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.684925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.685420 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.687875 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.709759 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-928b4104-2469-4ec4-b567-29af7acc8580 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.409068 Jul 28 09:26:58.710345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 197/412] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:58 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:58.719825 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:58.719825 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:58.722338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.722728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.723529 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:58.724400 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:58.840709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.851457 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a6674edb-4565-4a29-b986-a6218d1333e7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1139 microversion: 2.1 time: 0.181826 Jul 28 09:26:58.852257 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 216/413] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:58 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1139 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:58.939340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.947561 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.948943 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:58.950113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-821e6802-b399-4a69-85e0-decd524a2f2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.238817 Jul 28 09:26:58.950669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 198/414] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:26:58 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:26:59.328933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:59.329466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:59.335759 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:59.336218 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:59.337005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:59.337437 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:59.617668 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:26:59.629056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c8805dc7-4498-4125-aae2-4e6be185b0ec tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.304521 Jul 28 09:26:59.629950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 217/415] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:59 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:26:59.686780 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:59.687674 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:59.694995 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:59.695824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:59.697906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:59.699035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:59.727354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:26:59.727984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:26:59.734289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:59.734725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:26:59.735500 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:26:59.741833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.025196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.035871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f0f099ae-e92c-4306-b4f2-0485d940c830 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.353699 Jul 28 09:27:00.043030 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.052304 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bc672c4b-1e3d-4689-bc91-837b94d719dd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.329569 Jul 28 09:27:00.053069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 218/416] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:59 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:00.063027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 199/417] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:26:59 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:00.063027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:00.063027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:00.066336 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:00.066800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.068076 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:00.068522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.069567 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:00.070374 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:00.077550 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:00.078593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.079649 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:00.080274 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.185062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.197942 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7f6da665-ce38-47fc-aa10-2d357bcfaa44 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1193 microversion: 2.1 time: 0.142916 Jul 28 09:27:00.208884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 200/418] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:00 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1193 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:00.321203 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.331143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.332820 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.334116 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2fb3c3e2-7ba1-43f2-aa5c-1f22ef5b2f45 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.269278 Jul 28 09:27:00.334705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 219/419] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:00 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:00.648389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:00.649002 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:00.657023 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:00.657733 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.658823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:00.659365 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:00.929561 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:00.939496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3cf138fc-a40b-4851-85da-d2d62daded4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.295458 Jul 28 09:27:00.940363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 201/420] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:00 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:01.055024 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:01.055668 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:01.062735 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.063186 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.065055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.065055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.070462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:01.071081 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:01.079109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.081854 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.083345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.085173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.395231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.403742 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c839cbb5-724d-4d4c-9bd6-87753ca8bceb tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.337328 Jul 28 09:27:01.404495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 202/421] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:01 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:01.414003 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:01.414003 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:01.417928 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.418534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.418650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.419494 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.420080 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.429755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b70fec98-c762-4f6c-98ae-ad44385e579f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.379901 Jul 28 09:27:01.430755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 220/422] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:01 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:01.435330 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:01.437196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:01.445128 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.445817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.446801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.447237 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.850795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.857703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.865935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.866419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dae5eace-2ded-4407-a30a-3a539d1b7847 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.460649 Jul 28 09:27:01.867345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 203/423] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:01 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:01.871518 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:01.875547 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5ce87d3c-3c6f-4984-b9df-a28b765f59ec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.441123 Jul 28 09:27:01.877258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 221/424] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:01 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:01.878577 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-319d3fc7-f757-4a04-9e6d-f85a81cf0445 req-36e60058-44d8-4b9b-afe0-f2d547a6818b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:01.880251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:01.880251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:01.888382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-319d3fc7-f757-4a04-9e6d-f85a81cf0445 req-36e60058-44d8-4b9b-afe0-f2d547a6818b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.888826 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-319d3fc7-f757-4a04-9e6d-f85a81cf0445 req-36e60058-44d8-4b9b-afe0-f2d547a6818b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.901197 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-319d3fc7-f757-4a04-9e6d-f85a81cf0445 req-36e60058-44d8-4b9b-afe0-f2d547a6818b service nova] Creating event network-changed:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:27:01.906691 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-319d3fc7-f757-4a04-9e6d-f85a81cf0445 req-36e60058-44d8-4b9b-afe0-f2d547a6818b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038361 Jul 28 09:27:01.907280 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 204/425] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:01.957673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:01.958318 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:01.965735 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.966181 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:01.967332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:01.967838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.207031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:02.215056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9fe7c0b3-3954-4cdb-93e6-f2f19c0683fd tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1568 microversion: 2.1 time: 0.261061 Jul 28 09:27:02.215728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 222/426] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:01 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:02.422554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:02.424021 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:02.430583 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.431055 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.431896 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.432357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.447886 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:02.449302 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:02.455845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.456219 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.457000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.457432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.788102 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:02.797532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b4471bd2-2b7f-4878-9538-a1270d021248 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.379623 Jul 28 09:27:02.798066 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 205/427] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:02 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:02.805452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:02.832222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-219dcfd6-0477-4c0c-bcad-61d16981a226 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.385982 Jul 28 09:27:02.833134 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 223/428] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:02 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:02.890125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:02.894386 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:02.894534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:02.895326 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:02.904410 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.905796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.906734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.907330 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.915069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.915807 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:02.917210 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:02.917838 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.225881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:03.239073 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:03.246736 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:03.248484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-15772490-c8f2-4c3c-a591-553bffcea74f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.357643 Jul 28 09:27:03.249571 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 224/429] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:02 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:03.254768 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-ff40aefd-a076-4653-a069-d49c94c606ee req-4c39fa42-c284-444b-8a4f-c041a9275fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a2647e-a9b0-45df-a370-c027a06a66c0", "name": "network-vif-plugged", "status": "completed", "tag": "b6472eff-77ac-4376-8a00-5243d63b6c05"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:03.256602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:03.256602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:27:03.263768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:03.264524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-ff40aefd-a076-4653-a069-d49c94c606ee req-4c39fa42-c284-444b-8a4f-c041a9275fad service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.265104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-ff40aefd-a076-4653-a069-d49c94c606ee req-4c39fa42-c284-444b-8a4f-c041a9275fad service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.272393 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d2e52731-f4be-4101-ae1b-d9b583e1b609 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.390689 Jul 28 09:27:03.272957 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 206/430] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:02 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:03.278136 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:03.279217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:03.282800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-ff40aefd-a076-4653-a069-d49c94c606ee req-4c39fa42-c284-444b-8a4f-c041a9275fad service nova] Creating event network-vif-plugged:b6472eff-77ac-4376-8a00-5243d63b6c05 for instance 32a2647e-a9b0-45df-a370-c027a06a66c0 on hv-cinder-80266 Jul 28 09:27:03.286063 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.286501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.287277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.287733 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.288292 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-ff40aefd-a076-4653-a069-d49c94c606ee req-4c39fa42-c284-444b-8a4f-c041a9275fad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037400 Jul 28 09:27:03.289035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 225/431] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:03.493638 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:03.501801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e804e0cc-59dc-4fd9-b5f5-789231b14ec9 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1548 microversion: 2.1 time: 0.227696 Jul 28 09:27:03.502380 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 207/432] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:03 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:03.519188 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:03.519872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:03.525992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.526526 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.527812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.528331 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.617299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] HTTP exception thrown: Cannot 'detach_volume' instance 722bacfd-c01b-427f-a5db-de2581b3dc2e while it is in vm_state rescued Jul 28 09:27:03.618029 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Returning 409 to user: Cannot 'detach_volume' instance 722bacfd-c01b-427f-a5db-de2581b3dc2e while it is in vm_state rescued {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:03.618913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b16ee504-f119-4762-b93c-5626b26b6c9c tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "DELETE /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments/60513e0f-a321-430f-857a-bcb3a2c81814" status: 409 len: 152 microversion: 2.1 time: 0.103986 Jul 28 09:27:03.619807 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 226/433] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:27:03 2021] DELETE /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments/60513e0f-a321-430f-857a-bcb3a2c81814 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 09:27:03.627830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:03.628615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:03.635167 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.635707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.636537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.636971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.706236 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-753862bf-79d1-4288-b14b-91a7dd1ff6e7 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action" status: 202 len: 0 microversion: 2.1 time: 0.081917 Jul 28 09:27:03.709757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 208/434] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:27:03 2021] POST /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:27:03.714816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:03.715463 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:03.722064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.722550 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.723371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.723845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.814675 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:03.815391 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:03.822350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.822825 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.823765 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:03.824196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:03.977803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:03.989093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f80e7631-a6e8-4d9b-b884-3cef46dd9efa tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1556 microversion: 2.1 time: 0.277847 Jul 28 09:27:03.989782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 227/435] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:03 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1556 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:04.001196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:04.002001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:04.008170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:04.008770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:04.009588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:04.010097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:04.100182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.108913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-76758644-9755-4530-9264-629a364cab5b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.298442 Jul 28 09:27:04.109660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 209/436] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:03 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:04.263067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.267008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:04.268012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:04.274564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:04.275315 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:04.275605 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fc218bde-e513-4682-86e2-93af61cf1e7d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1317 microversion: 2.1 time: 0.278480 Jul 28 09:27:04.276474 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 228/437] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:03 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:04.277116 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:04.277800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:04.290445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:04.291070 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:04.297486 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:04.297937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:04.299256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:04.299256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:04.555346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.566377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.569176 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.572259 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-28006ab4-4a61-45dd-a346-ef411c96aa41 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.309073 Jul 28 09:27:04.579951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 210/438] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:04 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:04.595343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:04.610357 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6d151c20-561e-4353-aba0-53bdf74358e8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.323718 Jul 28 09:27:04.611068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 229/439] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:04 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:05.005913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:05.006521 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:05.012829 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.013208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.014002 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.014493 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.126276 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:05.126918 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:05.132883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.133332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.134105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.134545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.150494 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.159398 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ab2e553c-3fc6-43a6-9470-e57d65a3d60a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1556 microversion: 2.1 time: 0.157038 Jul 28 09:27:05.159998 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 211/440] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:05 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:05.269245 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.279208 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-82e04fdf-9edf-4ba1-b858-e7810b490574 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.156765 Jul 28 09:27:05.280768 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 230/441] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:05 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:05.293780 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:05.294525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:05.301555 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.302001 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.302813 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.303246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.428726 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.436220 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-83673be9-8ee5-4c76-b17d-e299890f72b2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1507 microversion: 2.1 time: 0.146469 Jul 28 09:27:05.436793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 212/442] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:05 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:05.594342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:05.594992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:05.602207 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.602982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.603364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.603846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.630498 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:05.631285 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:05.637894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.638507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.640009 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:05.640707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:05.828727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.832430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.836812 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-29df020e-899a-4481-9829-d6223a5fcf30 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.210310 Jul 28 09:27:05.837379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 213/443] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:05 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:05.840889 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.842650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:05.843883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7e64ae83-7aa8-403d-bbc3-4ed19db5d3a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.254668 Jul 28 09:27:05.844512 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 231/444] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:05 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:06.177690 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:06.178299 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:06.184330 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.184775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.185538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.187275 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.299587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:06.300223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:06.306298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.306836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.307809 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.308339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.332454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:06.341368 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c10ff2b2-3c2b-4ade-adcb-de0a75c73848 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1556 microversion: 2.1 time: 0.167166 Jul 28 09:27:06.341954 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 214/445] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:06 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:06.447714 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:06.456217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7d2ae898-00a7-460b-a2e4-778fdce6d141 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.161462 Jul 28 09:27:06.456786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 232/446] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:06 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:06.800033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67480eb0-f9e3-4fef-bd0c-a498d82810d2"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:06.801238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:06.807098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.807544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.808331 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.808764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.853787 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:06.854384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:06.860734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.861185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.861943 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:06.862369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:06.992811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.001017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-94e76837-0354-419d-b1ae-82108ecffac9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.150686 Jul 28 09:27:07.001815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 233/447] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:06 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:07.016000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:07.016851 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:07.023670 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.024123 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.024919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.025326 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.070427 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b0588c44-6897-40af-8af7-a9910f23d1c2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "POST /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273980 Jul 28 09:27:07.071636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 215/448] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:27:06 2021] POST /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:07.176940 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.189245 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.190751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.191925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4191232d-a354-4dd6-8ff1-a6290fed769e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.180421 Jul 28 09:27:07.192658 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 234/449] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:07 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:07.359258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:07.359979 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:07.366007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.366453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.367240 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.367728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.473756 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:07.474497 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:07.480759 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.481403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.482345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.483899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.490233 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.498964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-de599968-6583-4e72-b4dc-3c83fc8ebafe tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1562 microversion: 2.1 time: 0.143483 Jul 28 09:27:07.499274 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 216/450] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:07 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1562 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:07.588975 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:07.589950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:07.596371 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.596934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.597768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:07.598291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:07.629332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:07.640032 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6c280c1c-40db-406a-b63e-1e47a8c945ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.170019 Jul 28 09:27:07.640618 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 235/451] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:07 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:07.692879 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lazy-loading 'services' on Instance uuid 722bacfd-c01b-427f-a5db-de2581b3dc2e {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:27:07.757270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5febe85d-c6aa-4c48-a128-55fd11262fe2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "DELETE /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments/60513e0f-a321-430f-857a-bcb3a2c81814" status: 202 len: 0 microversion: 2.1 time: 0.172281 Jul 28 09:27:07.757929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 217/452] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:27:07 2021] DELETE /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e/os-volume_attachments/60513e0f-a321-430f-857a-bcb3a2c81814 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:27:08.018725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:08.019359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:08.029846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:08.029846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:08.029846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:08.029846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:08.159719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:08.167923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-eac664f0-0709-488d-9300-3b1ee7af632e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.153442 Jul 28 09:27:08.169073 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 236/453] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:08 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:08.222126 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:08.222815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:08.228994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:08.229440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:08.230193 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:08.230630 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:08.353095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:08.361402 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:08.362893 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:08.364058 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-140ae835-8dea-4d02-bb37-dbc1264bf665 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.146491 Jul 28 09:27:08.364606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 218/454] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:08 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:08.657981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:08.658595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:08.664725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:08.665163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:08.665946 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:08.666367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:08.813779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:08.823297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2d728906-2c3b-4187-b62f-3f501d7ce991 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.169452 Jul 28 09:27:08.824039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 237/455] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:08 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:09.185244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:09.186554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:09.193243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:09.193977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:09.195615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:09.195615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:09.343993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:09.351134 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5c02ef63-bb18-4e04-b725-18995957b0e4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.169734 Jul 28 09:27:09.351697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 219/456] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:09 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:09.381987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:09.382645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:09.388523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:09.389177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:09.389929 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:09.390355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:09.518480 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:09.530633 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:09.532279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:09.533473 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f2d93061-2f3d-4c92-b4d2-7b29af8728f4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.155298 Jul 28 09:27:09.534065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 238/457] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:09 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:09.848346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:09.849584 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:09.861257 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:09.861757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:09.862616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:09.863079 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:09.995524 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:10.003997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-35fdf561-a227-4499-a4df-b5f0a3c52db8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.163663 Jul 28 09:27:10.004764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 220/458] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:09 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:10.368621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:10.369244 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:10.375234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:10.375730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:10.376509 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:10.376944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:10.499718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:10.506881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9aec0c47-630d-4ec5-a5e5-8a50e15ba80c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.142465 Jul 28 09:27:10.507476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 239/459] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:10 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:10.552549 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:10.553196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:10.560100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:10.561337 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:10.562179 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:10.562684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:10.684046 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:10.691935 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:10.693448 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:10.694593 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c2407809-b583-467a-8cdb-df9d5e79f65b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.146867 Jul 28 09:27:10.695158 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 221/460] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:10 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:11.021724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:11.022258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:11.028674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:11.029046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:11.030106 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:11.030674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:11.159140 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:11.171119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4eeb70b1-77f7-4d87-b129-2f31a5635c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.153077 Jul 28 09:27:11.171725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 240/461] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:11 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:11.524453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:11.525071 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:11.532267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:11.532801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:11.533605 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:11.534045 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:11.674659 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:11.684226 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fdd794f7-4a81-4635-8627-70f839128dc9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.163996 Jul 28 09:27:11.685000 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 222/462] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:11 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:11.713757 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:11.714943 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:11.721781 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:11.722309 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:11.723177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:11.723653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:11.843627 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:11.851460 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:11.853092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:11.854066 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8e404cd1-40b8-4f4a-90b7-e42efcb4b2f1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.144110 Jul 28 09:27:11.854622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 241/463] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:11 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:12.189377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:12.190117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:12.196076 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:12.196526 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:12.197302 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:12.197738 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:12.324042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:12.332526 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-594e1c4a-b8aa-47de-870c-fa27f89d793d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.147901 Jul 28 09:27:12.333308 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 223/464] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:12 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:12.702448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:12.703141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:12.711238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:12.711821 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:12.712789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:12.713353 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:12.838299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:12.846049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-53337159-e7f6-41b7-9eea-491314d1c2a1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.148760 Jul 28 09:27:12.846588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 242/465] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:12 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:12.873865 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:12.874634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:12.880937 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:12.881381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:12.882149 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:12.882577 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:13.007822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:13.016282 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:13.017784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:13.018978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-39723379-ce36-432b-afe1-d0a298342ad6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.149413 Jul 28 09:27:13.019701 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 224/466] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:12 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:13.046504 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-aef21f6b-7a9c-43af-860c-088255ba3d9b req-b8854af9-bde1-42b0-951f-3f9d100e1e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "name": "network-vif-plugged", "status": "completed", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:13.048476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:13.048476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:27:13.058522 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-aef21f6b-7a9c-43af-860c-088255ba3d9b req-b8854af9-bde1-42b0-951f-3f9d100e1e20 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:13.059105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-aef21f6b-7a9c-43af-860c-088255ba3d9b req-b8854af9-bde1-42b0-951f-3f9d100e1e20 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:13.074497 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-aef21f6b-7a9c-43af-860c-088255ba3d9b req-b8854af9-bde1-42b0-951f-3f9d100e1e20 service nova] Creating event network-vif-plugged:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:27:13.083471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-aef21f6b-7a9c-43af-860c-088255ba3d9b req-b8854af9-bde1-42b0-951f-3f9d100e1e20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041832 Jul 28 09:27:13.084901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 243/467] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:13.349756 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:13.350362 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:13.356217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:13.356655 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:13.357451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:13.357879 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:13.542132 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:13.552416 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1484d98f-8b19-42ec-b064-d7ea89c25882 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.206228 Jul 28 09:27:13.553067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 225/468] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:13 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:13.863102 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:13.863775 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:13.869846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:13.870292 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:13.871063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:13.871498 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.005207 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:14.013321 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-23eff981-c53f-4e9a-aead-8d91adfcffb1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.154294 Jul 28 09:27:14.019697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 244/469] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:13 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:14.039065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:14.039914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:14.047172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:14.047654 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.048600 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:14.049059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.184235 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:14.193881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:14.195644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:14.197133 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d1d06e28-3be4-4e5a-b5f2-7c9a5845e454 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.162909 Jul 28 09:27:14.197795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 226/470] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:14 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:14.569675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:14.570297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:14.576807 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:14.577215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.578039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:14.578478 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.713629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:14.714083 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:14.714582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:14.721702 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:14.722298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.722842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0cfb2fe3-e803-4bf7-a8a2-a30a045c2b12 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.156927 Jul 28 09:27:14.723079 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:14.723479 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 245/471] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:14 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:14.723692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:14.808835 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lazy-loading 'services' on Instance uuid 32a2647e-a9b0-45df-a370-c027a06a66c0 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:27:14.878179 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-78450c1d-91d0-4886-8b4a-44f6a99d38f7 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0/os-volume_attachments/67480eb0-f9e3-4fef-bd0c-a498d82810d2" status: 202 len: 0 microversion: 2.1 time: 0.167698 Jul 28 09:27:14.878914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 227/472] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:27:14 2021] DELETE /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0/os-volume_attachments/67480eb0-f9e3-4fef-bd0c-a498d82810d2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:27:15.031139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:15.031800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:15.037800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:15.038246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:15.039029 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:15.039465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:15.169198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:15.177104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-444d3877-41e1-41a9-8c7d-1534dcde7081 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.150191 Jul 28 09:27:15.177669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 246/473] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:15 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:15.218189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:15.218901 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:15.226036 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:15.226512 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:15.227316 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:15.227785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:15.360286 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:15.368183 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:15.369699 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:15.370876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-967d2965-92ef-45f0-a90b-a8b53ed7bd9f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.157130 Jul 28 09:27:15.371438 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 228/474] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:15 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:15.740189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:15.740803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:15.746486 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:15.746931 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:15.747874 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:15.748606 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:15.878166 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:15.886159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-89c92a53-3304-4e5b-aaad-06f027442c6f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.149591 Jul 28 09:27:15.886983 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 247/475] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:15 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:16.194186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:16.195204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:16.200733 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:16.201240 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:16.202006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:16.202433 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:16.321694 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:16.329943 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-74d506e3-f808-491a-aedd-8b929b6567e2 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.139456 Jul 28 09:27:16.330503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 229/476] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:16 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:16.389937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:16.390545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:16.396364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:16.396810 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:16.397578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:16.398011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:16.527104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:16.538934 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:16.540458 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:16.541611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-be50ebea-d339-44fe-8df7-7ce1f0449260 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.156120 Jul 28 09:27:16.542163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 248/477] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:16 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:16.903680 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:16.904332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:16.910015 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:16.910459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:16.911237 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:16.911687 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.041425 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:17.049138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-39ee749d-427a-459d-879f-394851282d07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.149720 Jul 28 09:27:17.049692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 230/478] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:16 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:17.346284 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:17.346897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:17.352812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.353285 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.354051 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.354488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.472225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:17.479468 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b7e14157-f954-4a48-b51b-0764e5fc8b1c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1261 microversion: 2.1 time: 0.136961 Jul 28 09:27:17.480062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 249/479] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:17 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:17.559695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:17.560511 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:17.567366 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.568042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.568800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.569145 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.569902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:17.570456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:17.577801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.578249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.579048 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.579696 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.605348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:27:17.686031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-baf071b8-4664-4ccc-9f11-442f8c8b58e3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "DELETE /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 204 len: 0 microversion: 2.1 time: 0.119876 Jul 28 09:27:17.690883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 250/480] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:27:17 2021] DELETE /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:27:17.695441 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:17.696175 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:17.703097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.703548 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.704358 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:17.704796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:17.706561 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:17.715064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:17.716695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:17.717844 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ff4cea3c-50e1-4334-98f7-91c07312b695 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.161882 Jul 28 09:27:17.729918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 231/481] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:17 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:17.845140 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:17.852596 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6187b76d-7b23-4749-85d9-0d4b4542f9c2 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1507 microversion: 2.1 time: 0.161069 Jul 28 09:27:17.853153 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 251/482] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:17 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:18.067317 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.067869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.073646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.074090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.074850 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.075281 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.192603 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.193443 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.199205 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.199815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.200601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.201473 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.201834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.212371 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-474bfe26-4877-4059-b0ee-b7405be08a65 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.148733 Jul 28 09:27:18.212949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 232/483] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:18 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:18.233366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:27:18.309964 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4008e1b2-a18e-4872-b10e-c23538cf8772 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 204 len: 0 microversion: 2.1 time: 0.122225 Jul 28 09:27:18.311178 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 252/484] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:27:18 2021] DELETE /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:27:18.319114 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.319696 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.326138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.326603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.327389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.327863 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.450809 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.458491 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fb92cc83-7f13-460f-9313-b1f0e6925c47 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1513 microversion: 2.1 time: 0.143172 Jul 28 09:27:18.459053 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 233/485] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:18 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:18.496675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.497385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.503328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.503822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.504593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.505034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.631899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.639379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fadbeef3-f263-4db1-bc62-c4aeb7478d49 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1445 microversion: 2.1 time: 0.146746 Jul 28 09:27:18.639977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 253/486] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:18 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1445 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:18.656343 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.656976 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.662763 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.663209 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.664080 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.664514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.738099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.738808 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.745396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.745854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.746636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.747072 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.794426 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.795069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c1d3ab17-5aff-4f08-8aed-85575cec08ae tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1445 microversion: 2.1 time: 0.143027 Jul 28 09:27:18.795832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 234/487] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:18 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1445 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:18.869859 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:18.870484 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:18.874131 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.877437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.877886 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.878666 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:18.879140 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:18.881945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.883448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:18.884813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab7a9f40-6ebc-4812-adf1-bfa881b873c7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.151055 Jul 28 09:27:18.885369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 254/488] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:18 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:19.005480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:19.012736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-19bc80c7-b1ba-46e0-8a88-8b7025a28d60 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1507 microversion: 2.1 time: 0.146538 Jul 28 09:27:19.014000 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 235/489] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:18 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:19.229811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:19.230617 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:19.236594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:19.237340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:19.238130 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:19.238569 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:19.364969 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:19.373845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8676c6e6-d20d-42d7-84d2-416cfd8772c6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.147650 Jul 28 09:27:19.374414 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 255/490] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:19 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:19.475320 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:19.475963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:19.481727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:19.482194 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:19.483041 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:19.483473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:19.604142 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:19.612072 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9830332a-0876-44f7-bc5f-9964b082e20a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1513 microversion: 2.1 time: 0.140355 Jul 28 09:27:19.612832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 236/491] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:19 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:19.903521 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:19.904811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:19.911191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:19.911654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:19.912420 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:19.912846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.030973 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:20.031591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:20.037487 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.038006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.038993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.039647 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.048041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:20.056121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:20.057711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:20.058958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-82266b1c-afb2-45a4-b749-96bfb94cd5be tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.159673 Jul 28 09:27:20.060125 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 256/492] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:19 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:20.168994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:20.176356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-512b0f1d-4936-46f7-8c1b-06cddd38bd11 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1507 microversion: 2.1 time: 0.150000 Jul 28 09:27:20.176920 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 237/493] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:20 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:20.390286 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:20.390921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:20.396682 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.397126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.397888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.398320 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.522150 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:20.531297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7f9c03ce-763f-40ab-aa53-9a070edec307 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.144856 Jul 28 09:27:20.532243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 257/494] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:20 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:20.566463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-9c2b3aeb-bb93-400b-bd58-337beff7a187 req-0cb8dd52-93a6-4a67-8edd-cbd770582c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:20.568618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:20.568618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:20.576056 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-9c2b3aeb-bb93-400b-bd58-337beff7a187 req-0cb8dd52-93a6-4a67-8edd-cbd770582c75 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.576578 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-9c2b3aeb-bb93-400b-bd58-337beff7a187 req-0cb8dd52-93a6-4a67-8edd-cbd770582c75 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.588505 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-9c2b3aeb-bb93-400b-bd58-337beff7a187 req-0cb8dd52-93a6-4a67-8edd-cbd770582c75 service nova] Creating event network-changed:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:27:20.595268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-9c2b3aeb-bb93-400b-bd58-337beff7a187 req-0cb8dd52-93a6-4a67-8edd-cbd770582c75 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032654 Jul 28 09:27:20.595992 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 238/495] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:20.629318 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:20.630092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:20.636237 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.636823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.637700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:20.638293 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:20.840595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:20.851960 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f081b0f5-349f-4a91-a003-c8f37b6d928e tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1513 microversion: 2.1 time: 0.226268 Jul 28 09:27:20.862334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 258/496] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:20 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:21.078784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:21.080129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:21.086911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.087598 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.088596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.089032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.194583 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:21.195885 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:21.202192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.202628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.203390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.203839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.319833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:21.327899 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:21.329479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:21.332762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bfb818b8-bf7b-4d5e-a3a2-cfac8ef3c287 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1744 microversion: 2.20 time: 0.259062 Jul 28 09:27:21.334065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 239/497] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:21 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:21.552784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:21.553405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:21.560089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.560518 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.561596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.562072 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.652616 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:21.661878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b1c19560-ce38-4c1b-ac4c-654ed6d8631f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1507 microversion: 2.1 time: 0.471433 Jul 28 09:27:21.663106 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 259/498] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:21 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:21.751526 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:21.759395 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a0279c57-64f6-4be6-b1ab-3d0f6d14386a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.210388 Jul 28 09:27:21.760060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 240/499] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:21 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:21.869242 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:21.869866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:21.876227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.876677 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:21.877466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:21.877874 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.056307 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:22.063735 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cd48cf96-b0ae-4eb1-8be4-98240de7f4c0 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 200 len: 1513 microversion: 2.1 time: 0.198162 Jul 28 09:27:22.064307 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 260/500] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:21 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:22.190004 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-33f1faa0-872e-4e00-8b28-cd05a21e22c0 req-be21f367-6f68-42fb-822d-34aabbdb1375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a2647e-a9b0-45df-a370-c027a06a66c0", "name": "network-vif-deleted", "tag": "b6472eff-77ac-4376-8a00-5243d63b6c05"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:22.192467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:22.192467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:22.202729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-33f1faa0-872e-4e00-8b28-cd05a21e22c0 req-be21f367-6f68-42fb-822d-34aabbdb1375 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.203628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-33f1faa0-872e-4e00-8b28-cd05a21e22c0 req-be21f367-6f68-42fb-822d-34aabbdb1375 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.220782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-33f1faa0-872e-4e00-8b28-cd05a21e22c0 req-be21f367-6f68-42fb-822d-34aabbdb1375 service nova] Creating event network-vif-deleted:b6472eff-77ac-4376-8a00-5243d63b6c05 for instance 32a2647e-a9b0-45df-a370-c027a06a66c0 on hv-cinder-80266 Jul 28 09:27:22.227886 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-33f1faa0-872e-4e00-8b28-cd05a21e22c0 req-be21f367-6f68-42fb-822d-34aabbdb1375 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042588 Jul 28 09:27:22.228502 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 241/501] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:22.351259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:22.351815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:22.357532 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.357984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.358764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.359195 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.481077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:22.488879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:22.490382 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:22.491519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-addb233c-195e-4b60-b592-11fc2eaea9e5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1744 microversion: 2.20 time: 0.144098 Jul 28 09:27:22.492097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 261/502] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:22 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1744 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:22.683027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:22.684002 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:22.690437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.690890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.691676 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.692109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.776543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:22.777539 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:22.784168 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.784723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.785751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:22.786387 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:22.935799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:22.949097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d962ede0-8c46-42aa-a99f-8ca481e9b605 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 200 len: 1507 microversion: 2.1 time: 0.269990 Jul 28 09:27:22.949882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 242/503] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:22 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:23.009145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:23.029854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c261e996-d71c-4909-9590-f774e4443a9c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.256740 Jul 28 09:27:23.031018 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 262/504] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:22 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:23.080919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:23.081745 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 32a2647e-a9b0-45df-a370-c027a06a66c0] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:23.088938 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:23.089462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:23.090439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:23.090926 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:23.107289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] HTTP exception thrown: Instance 32a2647e-a9b0-45df-a370-c027a06a66c0 could not be found. Jul 28 09:27:23.109726 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Returning 404 to user: Instance 32a2647e-a9b0-45df-a370-c027a06a66c0 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:23.112319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-40e507e6-1544-4a6f-96d2-50d3bcc56be9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0" status: 404 len: 111 microversion: 2.1 time: 0.035093 Jul 28 09:27:23.113427 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 243/505] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:23 2021] GET /compute/v2.1/servers/32a2647e-a9b0-45df-a370-c027a06a66c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:27:23.509601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:23.510371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:23.518111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:23.518492 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:23.519270 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:23.519737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:23.659271 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:23.667429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:23.669082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:23.670903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-88a3c26a-4594-4b80-ac89-8f0b2b9e807d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1744 microversion: 2.20 time: 0.165081 Jul 28 09:27:23.671528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 263/506] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:23 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:23.965786 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:23.966923 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:23.972780 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:23.973219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:23.973972 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:23.974403 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:23.988258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] HTTP exception thrown: Instance 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 could not be found. Jul 28 09:27:23.988843 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Returning 404 to user: Instance 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:23.989660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ecc04a8f-aba4-44e7-a59a-419d4cf4a3c3 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67" status: 404 len: 111 microversion: 2.1 time: 0.027559 Jul 28 09:27:23.990182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 244/507] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:23 2021] GET /compute/v2.1/servers/89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:27:23.997963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:23.998455 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:24.004446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.004961 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.005833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.006261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.031155 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:27:24.046938 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:24.047817 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:24.053612 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.054299 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.055273 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.055740 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.110011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9b7657ee-e6b1-4da2-ac60-b12108e27c77 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "DELETE /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 204 len: 0 microversion: 2.1 time: 0.115416 Jul 28 09:27:24.110598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 264/508] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:27:23 2021] DELETE /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:27:24.119639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:24.120570 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:24.127547 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.128030 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.128952 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.129385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.216636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:24.225062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-353e3f1a-15ca-4b1f-b347-c58723055780 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.182154 Jul 28 09:27:24.225959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 245/509] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:24 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:24.245361 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-de231609-9a57-41ec-86e2-c8741ee2e28e req-1921ad33-aa32-4061-b654-7c6fadb8d69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67", "name": "network-vif-deleted", "tag": "516a84f0-5846-45f0-8ffc-f11a2e8eec67"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:24.247022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:24.247022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:24.256803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-de231609-9a57-41ec-86e2-c8741ee2e28e req-1921ad33-aa32-4061-b654-7c6fadb8d69f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.257522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-de231609-9a57-41ec-86e2-c8741ee2e28e req-1921ad33-aa32-4061-b654-7c6fadb8d69f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.276389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-de231609-9a57-41ec-86e2-c8741ee2e28e req-1921ad33-aa32-4061-b654-7c6fadb8d69f service nova] Creating event network-vif-deleted:516a84f0-5846-45f0-8ffc-f11a2e8eec67 for instance 89bf9e96-f9c0-4e9b-9eb6-a01c13b4ac67 on hv-cinder-80266 Jul 28 09:27:24.281839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-de231609-9a57-41ec-86e2-c8741ee2e28e req-1921ad33-aa32-4061-b654-7c6fadb8d69f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039966 Jul 28 09:27:24.282495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 246/510] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:27:24.287362 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:24.287968 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:24.293991 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.295471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.296458 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.296896 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.301648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:24.309726 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2c87a216-f70a-425d-a256-01dd944c1e88 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.194752 Jul 28 09:27:24.310608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 265/511] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:24 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:24.323317 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:27:24.404932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c35a77f3-240c-478c-a4a4-43ad9952fb39 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 204 len: 0 microversion: 2.1 time: 0.120516 Jul 28 09:27:24.409413 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 247/512] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:27:24 2021] DELETE /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:27:24.414506 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:24.415157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:24.421376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.421823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.422599 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.423028 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.545684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:24.552891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b3864f16-5c5c-4717-9eee-666dc18038c8 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1513 microversion: 2.1 time: 0.142313 Jul 28 09:27:24.553448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 266/513] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:24 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:24.690071 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:24.690771 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:24.696496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.696943 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.697708 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:24.698141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:24.822906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:24.831218 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:24.832777 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:24.833919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e80d122e-4f30-4aef-aedb-aaf66f3bd2af tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1744 microversion: 2.20 time: 0.148859 Jul 28 09:27:24.834469 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 248/514] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:24 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:25.085308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-f83342b5-ef70-4e19-a9ae-234849e50620 req-29bcb2d4-8be4-46a2-ba37-92f6261430f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "name": "network-vif-plugged", "status": "completed", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:25.086939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:25.086939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:27:25.094354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-f83342b5-ef70-4e19-a9ae-234849e50620 req-29bcb2d4-8be4-46a2-ba37-92f6261430f3 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.094854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-f83342b5-ef70-4e19-a9ae-234849e50620 req-29bcb2d4-8be4-46a2-ba37-92f6261430f3 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.106264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-f83342b5-ef70-4e19-a9ae-234849e50620 req-29bcb2d4-8be4-46a2-ba37-92f6261430f3 service nova] Creating event network-vif-plugged:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:27:25.111830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-f83342b5-ef70-4e19-a9ae-234849e50620 req-29bcb2d4-8be4-46a2-ba37-92f6261430f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030401 Jul 28 09:27:25.112413 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 267/515] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:25.241766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:25.242379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:25.248581 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.249035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.249801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.250237 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.327868 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:25.329000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:25.335114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.335556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.336344 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.336771 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.369642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:25.377746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3c1f98e3-2494-4541-9447-a6f31c1229d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.139586 Jul 28 09:27:25.378326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 249/516] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:25 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:25.456579 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:25.463858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2195823b-69ce-4edf-8d0c-30f8cba565cf tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.140545 Jul 28 09:27:25.464428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 268/517] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:25 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:25.570370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:25.570974 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:25.576859 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.577348 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.578057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.578488 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.700599 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:25.707696 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b9fcc98e-b1ae-4c76-ba65-2f968e6e2a6a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1513 microversion: 2.1 time: 0.140971 Jul 28 09:27:25.708263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 250/518] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:25 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:25.851144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:25.851690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:25.858650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.859358 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.860153 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:25.860580 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:25.979597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:25.988008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:25.989501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:25.990638 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f9daad83-71c0-45c4-ad87-17cd3f9c3a73 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1744 microversion: 2.20 time: 0.143481 Jul 28 09:27:25.991192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 269/519] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:25 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1744 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:26.394924 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:26.395534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:26.401471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:26.401918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:26.402944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:26.403377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:26.481067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:26.481758 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:26.488589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:26.489042 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:26.489939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:26.490406 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:26.529586 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:26.537610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5e14cfb1-0c86-4fea-a103-8460d088626b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.146308 Jul 28 09:27:26.538264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 251/520] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:26 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:26.620316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:26.628225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2da4e448-e0a4-4058-b4db-ae5d5ca21b1e tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.151092 Jul 28 09:27:26.628786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 270/521] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:26 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:26.723958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:26.724575 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:26.730437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:26.730913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:26.731972 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:26.732424 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:26.851678 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:26.858971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-40cee1c6-2c8d-45a2-86e9-87715693bae2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1513 microversion: 2.1 time: 0.138619 Jul 28 09:27:26.859528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 252/522] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:26 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:27.008932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:27.009534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:27.015943 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.016388 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.017144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.017571 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.136706 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:27.144867 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:27.146348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:27.147475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-60441cec-3257-45f9-9a6f-935734d89b82 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1744 microversion: 2.20 time: 0.142378 Jul 28 09:27:27.148152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 271/523] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:27 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1744 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:27.553797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:27.554357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:27.560890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.561435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.562208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.562639 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.644919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:27.645537 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:27.651305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.651791 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.652833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.653275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.686070 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:27.693808 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f88a7fe0-6f21-41ff-be13-f4cd0e56c81f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.143669 Jul 28 09:27:27.694375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 253/524] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:27 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:27.779108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:27.786381 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-470f6e97-aece-499c-9268-3c1fb2cb7982 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.145144 Jul 28 09:27:27.786941 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 272/525] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:27 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:27.875915 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:27.876523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:27.882384 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.882822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:27.883603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:27.884025 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.006639 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:28.015075 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a8e1f56c-8434-429b-bae3-b74fc4a3af88 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1513 microversion: 2.1 time: 0.143562 Jul 28 09:27:28.015654 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 254/526] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:27 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:28.165627 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:28.166347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:28.172922 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:28.173427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.174212 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:28.174643 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.307174 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:28.315873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:28.317441 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:28.318727 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-600a8719-e0a3-4adf-8730-ec655d670b5b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.156855 Jul 28 09:27:28.319300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 273/527] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:28 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:28.711629 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:28.712173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:28.728381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:28.728835 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.729618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:28.730054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.807817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:28.808740 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:28.816902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:28.817695 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.818645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:28.821613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:28.860609 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:28.869338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c339875e-5ac8-4e89-a4bf-6f269d3041bd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.161758 Jul 28 09:27:28.879345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 255/528] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:28 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:28.958773 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:28.967279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1e721345-a474-4afd-9f89-a51f303aaf29 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.165999 Jul 28 09:27:28.968104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 274/529] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:28 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:29.031689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:29.032597 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:29.038506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.038951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.039771 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.040211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.173944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:29.181741 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8e252277-c66e-46fc-a4c8-a3fe0fed706a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1513 microversion: 2.1 time: 0.154302 Jul 28 09:27:29.191817 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 256/530] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:29 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:29.337704 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:29.338319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:29.345215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.345859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.346798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.347393 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.480611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:29.489141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:29.490729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:29.492136 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fcc2cf3e-c4eb-4877-9083-b032068a7ab3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.158976 Jul 28 09:27:29.492897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 275/531] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:29 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:29.888528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:29.889335 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:29.900378 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.901134 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.902168 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.906655 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.985071 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:29.986462 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:29.995949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.996555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:29.998261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:29.998938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:30.226449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:30.235927 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-752fce1b-888f-489d-ba79-4ca9617949e2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.352974 Jul 28 09:27:30.236870 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 257/532] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:29 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:30.250615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:30.251727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:30.258617 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:30.259163 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:30.260047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:30.260555 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:30.297686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:30.314363 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f02e1c4e-81d7-48ce-b483-355b1b8f5e1f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.333548 Jul 28 09:27:30.315646 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 276/533] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:29 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:30.474067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:30.482548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0e589dc1-0f5d-4e63-a17b-c725c8632335 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 200 len: 1513 microversion: 2.1 time: 0.236530 Jul 28 09:27:30.495621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 258/534] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:30 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:30.515050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:30.515875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:30.522112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:30.522688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:30.523596 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:30.524156 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:30.719699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:30.727609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:30.729125 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:30.730278 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-811d614c-4d2f-4cf3-b9d3-eb62cd1175cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.220699 Jul 28 09:27:30.730829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 277/535] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:30 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:30.826670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-7c8ee362-6021-49bd-bad2-cfc6f4a1c359 req-b6b52a60-f146-4145-95bb-3d01ee85c451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cf3764-aba2-4eae-aede-98a02e101b36", "name": "network-vif-deleted", "tag": "1d9fa0e6-e536-4fd0-8183-daae01924304"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:30.828809 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:30.828809 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:30.859063 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-7c8ee362-6021-49bd-bad2-cfc6f4a1c359 req-b6b52a60-f146-4145-95bb-3d01ee85c451 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:30.864952 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-7c8ee362-6021-49bd-bad2-cfc6f4a1c359 req-b6b52a60-f146-4145-95bb-3d01ee85c451 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:30.879028 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-7c8ee362-6021-49bd-bad2-cfc6f4a1c359 req-b6b52a60-f146-4145-95bb-3d01ee85c451 service nova] Creating event network-vif-deleted:1d9fa0e6-e536-4fd0-8183-daae01924304 for instance f5cf3764-aba2-4eae-aede-98a02e101b36 on hv-cinder-80266 Jul 28 09:27:30.885554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-7c8ee362-6021-49bd-bad2-cfc6f4a1c359 req-b6b52a60-f146-4145-95bb-3d01ee85c451 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062882 Jul 28 09:27:30.886421 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 259/536] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:31.254214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:31.258648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:31.269225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.269737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.270485 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.271113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.333661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:31.334716 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:31.342431 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.343022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.345110 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.345663 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.403909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:31.412725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fa89c8e8-bc9c-4c41-884a-33e358f13fef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.162545 Jul 28 09:27:31.423072 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 278/537] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:31 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:31.503112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:31.503814 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: f5cf3764-aba2-4eae-aede-98a02e101b36] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:31.521442 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.523326 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.524942 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.525400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.528008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:31.538454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d569b02d-e93e-4144-b5ab-d3a06537386f tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.209522 Jul 28 09:27:31.543353 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] HTTP exception thrown: Instance f5cf3764-aba2-4eae-aede-98a02e101b36 could not be found. Jul 28 09:27:31.544950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Returning 404 to user: Instance f5cf3764-aba2-4eae-aede-98a02e101b36 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:31.545985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a876cddb-5c6d-49c3-a122-d83294dc8a8f tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36" status: 404 len: 111 microversion: 2.1 time: 0.047163 Jul 28 09:27:31.549826 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 260/539] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:31 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:31.549987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 279/539] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:31 2021] GET /compute/v2.1/servers/f5cf3764-aba2-4eae-aede-98a02e101b36 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:27:31.554480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:31.554968 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:31.561588 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.562337 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.563290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.563912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.591432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:27:31.673358 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0d4bf545-a946-4d73-94cb-2fb1b7e4f976 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 204 len: 0 microversion: 2.1 time: 0.122030 Jul 28 09:27:31.674276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 261/540] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:27:31 2021] DELETE /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:27:31.682410 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:31.683120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:31.689745 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.690280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.691280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.691803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.751463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:31.752206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:31.758785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.759277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.760124 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:31.760603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:31.856024 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:31.864126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-32600e1d-0bcc-4eb9-b128-3c79fef789b9 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1513 microversion: 2.1 time: 0.185632 Jul 28 09:27:31.874197 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 280/541] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:31 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:31.924640 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:31.933038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:31.935463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:31.936860 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-509fb824-3818-4cd7-8b11-cdf022c4a954 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.191854 Jul 28 09:27:31.938040 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 262/542] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:31 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:32.431232 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:32.431938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:32.438537 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.438981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.439812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.440335 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.565377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:32.566696 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:32.576975 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.577736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.579330 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.579950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.593229 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:32.605658 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bc27b53b-ea8e-4409-b66c-2b70f125aee4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.178252 Jul 28 09:27:32.613117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 281/543] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:32 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:32.748911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:32.756885 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ac59bbc8-fd29-42bf-b32a-b94b38812437 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.203806 Jul 28 09:27:32.767849 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 263/544] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:32 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:32.881347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:32.882256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:32.890600 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.891276 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.892089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.892674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.955762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:32.956553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:32.967707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.968539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:32.969900 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:32.970567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:33.065997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:33.074017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-168093e1-a04d-4a30-b564-72d5ff3b4a5d tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1513 microversion: 2.1 time: 0.196216 Jul 28 09:27:33.074599 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 282/545] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:32 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:33.137042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:33.145352 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:33.146912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:33.148033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-57dac5ac-da24-4ee8-b89f-aef92ef8f19a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.196496 Jul 28 09:27:33.151839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 264/546] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:32 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:33.623885 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:33.625138 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:33.633375 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:33.635592 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:33.636426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:33.636860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:33.782382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:33.783170 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:33.793869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:33.793869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:33.794918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:33.795355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:33.806637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:33.817560 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1f776518-cd34-4b6b-a4af-7564ade19fe6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.198235 Jul 28 09:27:33.818908 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 283/547] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:33 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:33.950626 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:33.959883 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2212470d-86d8-4913-9b0b-fbbf7dc17ce0 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.189077 Jul 28 09:27:33.960473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 265/548] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:33 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:34.094383 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:34.095139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:34.101978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.102435 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.103275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.103753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.166427 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:34.167589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:34.174615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.175179 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.176101 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.176695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.306116 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:34.314452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ccbcc932-1bc9-48a4-bb92-8dbe2599e38a tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1513 microversion: 2.1 time: 0.224418 Jul 28 09:27:34.326198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 284/549] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:34 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:34.349788 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:34.358264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:34.359796 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:34.361019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9aa2ea66-17c0-479c-a2bc-548f882ac0c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.198605 Jul 28 09:27:34.361886 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 266/550] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:34 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:34.837033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:34.838547 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:34.844801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.845438 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.846505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.847222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.977977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:34.979355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:34.988186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.989058 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.990014 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:34.990604 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:34.991613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:35.004661 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f08127e2-e1de-4b0b-aeb4-4f653a890040 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.172400 Jul 28 09:27:35.014004 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 285/551] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:34 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:35.145131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:35.154641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2a2732e1-91f6-4b66-b2a7-d11bd439ef4a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.180590 Jul 28 09:27:35.155536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 267/552] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:34 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:35.332528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:35.333039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:35.339415 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:35.339907 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:35.341141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:35.341656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:35.382089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:35.382089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:35.389582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:35.390033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:35.390819 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:35.391261 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:35.550620 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:35.560536 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f207e210-9859-43cf-9051-cc1508485a60 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1513 microversion: 2.1 time: 0.231232 Jul 28 09:27:35.567854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 286/553] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:35 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:35.583287 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:35.592413 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:35.593941 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:35.595165 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-04d66abf-a336-4cfa-9169-a36f8a1057dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.217791 Jul 28 09:27:35.599640 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 268/554] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:35 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:36.062154 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:36.063510 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:36.070523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.070982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.071808 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.072244 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.171944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:36.173346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:36.182845 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.184744 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.186912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.187609 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.316101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:36.324769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-90b42e03-5202-43c6-97ee-12d378311c79 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1725 microversion: 2.1 time: 0.267184 Jul 28 09:27:36.326731 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 287/555] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:36 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:36.427986 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:36.437582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-17435e52-877c-4623-9035-5ca399fefbb1 tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.269894 Jul 28 09:27:36.438973 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 269/556] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:36 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:36.584806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:36.585432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:36.592471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.592987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.593797 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.594272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.660172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:36.660808 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:36.667127 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.667601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.668444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:36.669649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:36.996070 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:37.006297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d49f8020-0455-40cc-a376-f28c2d540c3c tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 200 len: 1513 microversion: 2.1 time: 0.425227 Jul 28 09:27:37.016429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 288/557] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:36 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 1513 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:37.068258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:37.090264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:37.094748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:37.109025 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-44116359-9137-4d80-8f69-9971bb39acd8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.445095 Jul 28 09:27:37.119712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 270/558] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:36 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:37.236965 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-8cf6ee82-21ff-46e5-915e-9fec3494b6cc req-6a159cf1-6440-4135-a54e-e4954002c57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a17c34-a3e3-44a8-9fc2-616e75f456ad", "name": "network-vif-deleted", "tag": "446844c5-42ac-4490-a52f-68f801c377f3"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:37.241542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:37.241542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:27:37.264477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8cf6ee82-21ff-46e5-915e-9fec3494b6cc req-6a159cf1-6440-4135-a54e-e4954002c57d service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:37.264927 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8cf6ee82-21ff-46e5-915e-9fec3494b6cc req-6a159cf1-6440-4135-a54e-e4954002c57d service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:37.306385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-8cf6ee82-21ff-46e5-915e-9fec3494b6cc req-6a159cf1-6440-4135-a54e-e4954002c57d service nova] Creating event network-vif-deleted:446844c5-42ac-4490-a52f-68f801c377f3 for instance a7a17c34-a3e3-44a8-9fc2-616e75f456ad on hv-cinder-80266 Jul 28 09:27:37.328367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-8cf6ee82-21ff-46e5-915e-9fec3494b6cc req-6a159cf1-6440-4135-a54e-e4954002c57d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096420 Jul 28 09:27:37.330325 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 289/559] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:37.343184 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:37.344503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:37.356101 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:37.358440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:37.361396 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:37.362116 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:37.460008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:37.461313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:37.469070 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:37.469521 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:37.470528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:37.471391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:37.849400 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:37.864819 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f756e4a7-f3c4-4835-adab-ea9aa12308d0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1702 microversion: 2.1 time: 0.525899 Jul 28 09:27:37.865818 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 271/560] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:37 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1702 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:37.867268 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acb53585b04741c98fff2fcf6d697145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd4025f7c74471e81aa73079f97a769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:37.876408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f784cf4b-b237-407b-83c7-6f27fd93265a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 200 len: 1522 microversion: 2.1 time: 0.423669 Jul 28 09:27:37.877434 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 290/561] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:37 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:37.887667 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-75c7f7f2-4ca3-472e-97ec-d6a666a8f477 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:37.893870 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-75c7f7f2-4ca3-472e-97ec-d6a666a8f477 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:37.894486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-75c7f7f2-4ca3-472e-97ec-d6a666a8f477 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:37.965705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-75c7f7f2-4ca3-472e-97ec-d6a666a8f477 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Going to try to start instance {{(pid=107292) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 28 09:27:38.009911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-75c7f7f2-4ca3-472e-97ec-d6a666a8f477 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 202 len: 0 microversion: 2.1 time: 0.126051 Jul 28 09:27:38.010507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 272/562] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:27:37 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:27:38.021172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:38.022166 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:38.024238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:38.025611 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: a7a17c34-a3e3-44a8-9fc2-616e75f456ad] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:38.031479 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.032498 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.034037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.034872 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.035062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.035370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.036207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.036650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.054219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] HTTP exception thrown: Instance a7a17c34-a3e3-44a8-9fc2-616e75f456ad could not be found. Jul 28 09:27:38.054830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Returning 404 to user: Instance a7a17c34-a3e3-44a8-9fc2-616e75f456ad could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:38.055712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4f4d1c72-1e26-43d1-bec3-d3c890d7feca tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad" status: 404 len: 111 microversion: 2.1 time: 0.036751 Jul 28 09:27:38.056479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 273/563] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:38 2021] GET /compute/v2.1/servers/a7a17c34-a3e3-44a8-9fc2-616e75f456ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:27:38.131470 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:38.132112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:38.139559 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.139712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.140835 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.141441 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.189103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:38.197465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3e3fa662-fa94-4470-808f-f116f3403666 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1711 microversion: 2.1 time: 0.182123 Jul 28 09:27:38.198305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 291/564] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:38 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:38.319532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:38.329070 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:38.330594 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:38.331924 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ede4be4f-2492-4948-bfee-5c54f08877bd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1739 microversion: 2.20 time: 0.204172 Jul 28 09:27:38.343129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 274/565] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:38 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:38.892784 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:38.893397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] [instance: 722bacfd-c01b-427f-a5db-de2581b3dc2e] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:38.899199 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.899672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.900444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:38.900872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:38.915854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] HTTP exception thrown: Instance 722bacfd-c01b-427f-a5db-de2581b3dc2e could not be found. Jul 28 09:27:38.916471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] Returning 404 to user: Instance 722bacfd-c01b-427f-a5db-de2581b3dc2e could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:38.917293 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-12a4ec3a-b356-4951-b53e-f72ace152e3a tempest-ServerRescueNegativeTestJSON-682752149 tempest-ServerRescueNegativeTestJSON-682752149-project] 10.222.0.23 "GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e" status: 404 len: 111 microversion: 2.1 time: 0.028238 Jul 28 09:27:38.917839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 292/566] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:38 2021] GET /compute/v2.1/servers/722bacfd-c01b-427f-a5db-de2581b3dc2e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:27:39.200012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:39.200608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:39.206810 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.207264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.208078 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.208522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.215213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:39.216194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:39.222678 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.223115 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.223925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.224513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.235979 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:27:39.328443 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7b19158a-1b0c-4651-9b81-5dc5fc7d23a2 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 204 len: 0 microversion: 2.1 time: 0.131193 Jul 28 09:27:39.332841 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 275/567] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:27:39 2021] DELETE /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:27:39.339564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:39.341002 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:39.347693 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.348230 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.349146 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.349645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.365206 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:39.373751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-201a533a-27a5-45b6-a7f7-85a95e5a5078 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1711 microversion: 2.1 time: 0.162362 Jul 28 09:27:39.374461 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 293/568] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:39 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:39.390334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:39.391684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:39.397900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.398430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.399223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.399692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.526441 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:39.539213 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c90b08e1-3246-4eea-a9c8-2faf84cc2150 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1513 microversion: 2.1 time: 0.203757 Jul 28 09:27:39.540907 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 276/569] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:39 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:39.589751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:39.598308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:39.599842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:39.601003 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0eef6e6f-2914-42a8-8c8b-b86029e2b346 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1721 microversion: 2.20 time: 0.218859 Jul 28 09:27:39.601559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 294/570] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:39 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:39.643086 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-cee883a9-b473-40b3-878a-5e33507e509e req-13c0829a-2381-4dc8-9c74-0597e71c4358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722bacfd-c01b-427f-a5db-de2581b3dc2e", "name": "network-vif-deleted", "tag": "2b4fdddf-03d6-4edc-b888-724b64f54c3b"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:39.644724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:39.644724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:39.651741 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-cee883a9-b473-40b3-878a-5e33507e509e req-13c0829a-2381-4dc8-9c74-0597e71c4358 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:39.652178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-cee883a9-b473-40b3-878a-5e33507e509e req-13c0829a-2381-4dc8-9c74-0597e71c4358 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:39.663547 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-cee883a9-b473-40b3-878a-5e33507e509e req-13c0829a-2381-4dc8-9c74-0597e71c4358 service nova] Creating event network-vif-deleted:2b4fdddf-03d6-4edc-b888-724b64f54c3b for instance 722bacfd-c01b-427f-a5db-de2581b3dc2e on hv-cinder-80266 Jul 28 09:27:39.668238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-cee883a9-b473-40b3-878a-5e33507e509e req-13c0829a-2381-4dc8-9c74-0597e71c4358 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 Jul 28 09:27:39.669032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 277/571] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:40.392782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:40.393427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:40.400151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:40.400598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:40.401370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:40.401801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:40.529480 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:40.537359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-242f086d-5d6f-4a6c-abb3-76c950c37c48 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1715 microversion: 2.1 time: 0.148196 Jul 28 09:27:40.538128 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 295/572] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:40 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:40.558402 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:40.559793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:40.566006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:40.566457 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:40.567291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:40.567749 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:40.625350 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:40.626541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:40.637875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:40.638324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:40.639489 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:40.640047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:40.741277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:40.752095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a2cb735e-c2f6-47f3-9f42-e813bf10c566 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1513 microversion: 2.1 time: 0.196631 Jul 28 09:27:40.760882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 278/573] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:40 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:40.882048 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:40.890994 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:40.892634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:40.894071 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b6bbef8d-67cf-4fcc-b1f9-4dec02f788d6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1721 microversion: 2.20 time: 0.278031 Jul 28 09:27:40.895038 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 296/574] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:40 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:41.120115 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-efe7403d-115e-402f-aae3-4980f24c6b95 req-40b3d3d9-56e5-4286-b047-6f278776fd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "name": "network-vif-unplugged", "status": "completed", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:41.122805 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:41.122805 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:41.131208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-efe7403d-115e-402f-aae3-4980f24c6b95 req-40b3d3d9-56e5-4286-b047-6f278776fd25 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:41.132051 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-efe7403d-115e-402f-aae3-4980f24c6b95 req-40b3d3d9-56e5-4286-b047-6f278776fd25 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:41.148119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-efe7403d-115e-402f-aae3-4980f24c6b95 req-40b3d3d9-56e5-4286-b047-6f278776fd25 service nova] Creating event network-vif-unplugged:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:27:41.159254 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-efe7403d-115e-402f-aae3-4980f24c6b95 req-40b3d3d9-56e5-4286-b047-6f278776fd25 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041935 Jul 28 09:27:41.161107 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 279/575] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:41.768764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:41.769369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:41.775564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:41.776268 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:41.777483 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:41.778012 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:41.915797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:41.917365 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:41.925095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:41.925710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:41.926612 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:41.927124 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:42.302614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56058a59ffca404ba8121aae6e09ce3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffc9329f42c48d5a02f450469dbaf89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:42.312952 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-381b325f-c383-4041-b956-69adffb04940 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 200 len: 1513 microversion: 2.1 time: 0.547889 Jul 28 09:27:42.313625 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 297/576] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:41 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 1513 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:42.315270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:42.323094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:42.325775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:42.327179 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3080afc0-4c9a-40f3-8bfe-9a94e8ef3d83 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1664 microversion: 2.20 time: 0.417070 Jul 28 09:27:42.327954 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 280/577] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:41 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1664 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:42.355410 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12e1d3c7-2dc0-4a13-b803-ff307eeb5892"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:42.357642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:42.367452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:42.367926 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:42.369491 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:42.370084 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:42.547746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-1ef3bb60-c104-4ca2-aa4d-5bc2a6968f10 req-26ada5c2-9264-4936-bdbe-7ff5649e7d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1287df-cb69-4058-b6ed-b2156f10ea45", "name": "network-vif-deleted", "tag": "d71e8fb8-deed-4e7a-ad68-64fbaee0e441"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:42.549393 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:27:42.549393 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:27:42.564167 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-1ef3bb60-c104-4ca2-aa4d-5bc2a6968f10 req-26ada5c2-9264-4936-bdbe-7ff5649e7d30 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:42.564606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-1ef3bb60-c104-4ca2-aa4d-5bc2a6968f10 req-26ada5c2-9264-4936-bdbe-7ff5649e7d30 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:42.581307 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-1ef3bb60-c104-4ca2-aa4d-5bc2a6968f10 req-26ada5c2-9264-4936-bdbe-7ff5649e7d30 service nova] Creating event network-vif-deleted:d71e8fb8-deed-4e7a-ad68-64fbaee0e441 for instance 6e1287df-cb69-4058-b6ed-b2156f10ea45 on hv-cinder-80266 Jul 28 09:27:42.598945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-1ef3bb60-c104-4ca2-aa4d-5bc2a6968f10 req-26ada5c2-9264-4936-bdbe-7ff5649e7d30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057665 Jul 28 09:27:42.599593 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 281/578] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:42.790186 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bd19b0ec-8961-43d4-9fed-76b57b00eee4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.446501 Jul 28 09:27:42.791718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 298/579] 10.222.0.23 () {62 vars in 1364 bytes} [Wed Jul 28 09:27:42 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-volume_attachments => generated 188 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:27:42.864804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:42.867327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:42.872991 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:42.873628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:42.874768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:42.875355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:42.980266 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-dc556b29-9af5-4335-93f2-28b7dfd1ea33 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action" status: 202 len: 0 microversion: 2.20 time: 0.119265 Jul 28 09:27:42.981182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 282/580] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:27:42 2021] POST /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:27:42.988878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:42.989757 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:42.998734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:42.999214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:43.000040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:43.000468 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:43.200479 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:43.211439 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:43.213494 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:43.216008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-360d61c9-b907-4bdb-83aa-0158170c2156 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1750 microversion: 2.20 time: 0.229893 Jul 28 09:27:43.216889 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 299/581] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:42 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:43.332498 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:43.333426 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] [instance: 6e1287df-cb69-4058-b6ed-b2156f10ea45] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:43.340931 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:43.341905 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:43.343422 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:43.344329 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:43.362241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] HTTP exception thrown: Instance 6e1287df-cb69-4058-b6ed-b2156f10ea45 could not be found. Jul 28 09:27:43.363300 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] Returning 404 to user: Instance 6e1287df-cb69-4058-b6ed-b2156f10ea45 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:43.364169 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7178a69e-e4e5-4335-b00a-eb79279f8536 tempest-AttachVolumeNegativeTest-1101656147 tempest-AttachVolumeNegativeTest-1101656147-project] 10.222.0.23 "GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45" status: 404 len: 111 microversion: 2.1 time: 0.037676 Jul 28 09:27:43.365019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 283/582] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:27:43 2021] GET /compute/v2.1/servers/6e1287df-cb69-4058-b6ed-b2156f10ea45 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:27:44.237282 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:44.237897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:44.247039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:44.247681 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:44.248468 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:44.248901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:44.433476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:44.442441 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:44.444343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:44.446358 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e72cfb69-3fd2-4fd5-9787-0029b5ef1e7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1750 microversion: 2.20 time: 0.215405 Jul 28 09:27:44.447434 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 300/583] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:44 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:45.465256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:45.466009 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:45.471741 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:45.472486 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:45.473514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:45.474400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:45.554360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c6bdbf26-f806-44e4-a781-a383ec9562c3 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Action: 'create', calling method: .version_select at 0x7f16d053c160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-183856895", "metadata": {"Type": "work"}}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:27:45.739387 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:45.754366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:45.755901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:45.757064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9f128952-e6f5-43f6-b9df-e13e464526cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.295523 Jul 28 09:27:45.757623 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 301/584] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:45 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:45.898306 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c6bdbf26-f806-44e4-a781-a383ec9562c3 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.477718 Jul 28 09:27:45.898922 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 284/585] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Jul 28 09:27:45 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 479 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 09:27:45.910714 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6677d3fb-e67e-4198-bf79-5cc1a31eeca3 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Calling method '.version_select at 0x7f16d04d2d30>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:45.966077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6677d3fb-e67e-4198-bf79-5cc1a31eeca3 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b" status: 200 len: 352 microversion: 2.1 time: 0.058315 Jul 28 09:27:45.967074 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 302/586] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:45 2021] GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:46.778617 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:46.779567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:46.790960 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:46.794621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:46.796952 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:46.797869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:46.978979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6b271f90-986a-4f4e-81a3-0b2773286001 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Calling method '.version_select at 0x7f16d05008b0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:47.045098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:47.060967 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:47.064088 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:47.069645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c258c2b2-7347-465f-b11f-2b7f47732d62 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.295734 Jul 28 09:27:47.071125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 285/587] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:46 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:47.084195 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6b271f90-986a-4f4e-81a3-0b2773286001 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b" status: 200 len: 353 microversion: 2.1 time: 0.109407 Jul 28 09:27:47.085100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 303/588] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:46 2021] GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:27:47.103090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fc7477a8-3e39-4ac3-8951-2dfa22884988 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Calling method '.version_select at 0x7f16d0fc9160>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:47.206764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fc7477a8-3e39-4ac3-8951-2dfa22884988 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b" status: 200 len: 353 microversion: 2.1 time: 0.112128 Jul 28 09:27:47.207324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 286/589] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:47 2021] GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:47.219604 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-597f67f2-86e1-4a3c-841e-8e4a87f45f89 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Calling method '.version_select at 0x7f16d04dc430>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:47.299212 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-597f67f2-86e1-4a3c-841e-8e4a87f45f89 tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b" status: 202 len: 0 microversion: 2.1 time: 0.084093 Jul 28 09:27:47.300607 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 304/590] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Jul 28 09:27:47 2021] DELETE /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:27:47.308339 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ce8b774c-1fed-4a2f-80ce-77ca70b2dc8d tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Calling method '.version_select at 0x7f16d05d1160>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:47.363642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ce8b774c-1fed-4a2f-80ce-77ca70b2dc8d tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b" status: 200 len: 352 microversion: 2.1 time: 0.058756 Jul 28 09:27:47.364249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 287/591] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:47 2021] GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:48.088659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:48.089362 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:48.095653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:48.096109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:48.096955 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:48.097343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:48.246957 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:48.255839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:48.257797 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:48.258952 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-17d97fa4-40d0-482a-ab77-8f3cc419e218 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.174113 Jul 28 09:27:48.260103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 305/592] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:48 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:48.376364 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-50cbd543-c0cc-479e-9e42-9cc353a63cfa tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Calling method '.version_select at 0x7f16d051fa60>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:48.421903 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-50cbd543-c0cc-479e-9e42-9cc353a63cfa tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] HTTP exception thrown: Volume 106f1884-32fc-4c24-84d5-c4189972f04b could not be found. Jul 28 09:27:48.422644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-50cbd543-c0cc-479e-9e42-9cc353a63cfa tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] Returning 404 to user: Volume 106f1884-32fc-4c24-84d5-c4189972f04b could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:27:48.424176 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-50cbd543-c0cc-479e-9e42-9cc353a63cfa tempest-VolumesGetTestJSON-878135606 tempest-VolumesGetTestJSON-878135606-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b" status: 404 len: 109 microversion: 2.1 time: 0.051502 Jul 28 09:27:48.424775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 288/593] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:48 2021] GET /compute/v2.1/os-volumes/106f1884-32fc-4c24-84d5-c4189972f04b => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:27:49.279170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:49.280470 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:49.286440 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:49.287156 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:49.288348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:49.288971 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:49.440353 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:49.458033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:49.460158 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:49.465011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-efe28c80-8621-45c1-ac8d-ba438e73aaff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.189793 Jul 28 09:27:49.468929 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 306/594] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:49 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:50.485652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:50.486489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:50.493060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:50.493502 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:50.494286 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:50.494717 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:50.635545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:50.645971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:50.647454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:50.648634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-27aad88f-1d5b-41a6-9a3d-ad0c1585a359 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.166917 Jul 28 09:27:50.649181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 289/595] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:50 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:51.666846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:51.667447 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:51.673843 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:51.674287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:51.675050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:51.675480 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:51.805109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:51.814177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:51.815714 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:51.816897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8eaf4f5c-acd5-48ce-ab0d-250a761a9d28 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.153859 Jul 28 09:27:51.817479 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 307/596] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:51 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:52.494723 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5f96e97a-68a1-4727-861d-1b17cd7fa342 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d0626550>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:52.548712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5f96e97a-68a1-4727-861d-1b17cd7fa342 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e78ebe6a-1752-451f-806b-1a9302cda9ab" status: 200 len: 350 microversion: 2.1 time: 0.057513 Jul 28 09:27:52.549366 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 290/597] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:52 2021] GET /compute/v2.1/os-volumes/e78ebe6a-1752-451f-806b-1a9302cda9ab => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:52.836246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:52.837518 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:52.845703 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:52.846664 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:52.848298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:52.848897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:53.029963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:53.049139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:53.050543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:53.051943 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d74d2030-8097-4187-9352-5189e32948df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.219934 Jul 28 09:27:53.052659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 308/598] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:52 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:53.969521 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d7da52ba-1f62-479b-816d-d3c3751fb559 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d242d940>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:54.027799 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d7da52ba-1f62-479b-816d-d3c3751fb559 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/52f283a7-97f4-4f86-ae42-c65fbd83dd7b" status: 200 len: 351 microversion: 2.1 time: 0.061462 Jul 28 09:27:54.028512 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 291/599] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:53 2021] GET /compute/v2.1/os-volumes/52f283a7-97f4-4f86-ae42-c65fbd83dd7b => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:54.071035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:54.072150 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:54.081751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:54.082568 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:54.083609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:54.084288 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:54.241257 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:54.252795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:54.254364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:54.255742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0daf6094-d033-47b2-8acf-72139706479a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.189161 Jul 28 09:27:54.256454 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 309/600] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:54 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:55.275338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:55.276139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:55.283435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:55.283904 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:55.284686 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:55.285119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:55.421506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:55.428068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6c111a31-de91-4dbc-9e79-fc7ded6e146c tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d04dcee0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:55.438251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:55.440139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:55.443636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-321171f4-e733-4dc0-8f3b-c44d8f14fb99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.169825 Jul 28 09:27:55.443636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 292/601] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:27:55.492897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6c111a31-de91-4dbc-9e79-fc7ded6e146c tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e33a62d1-7fd1-49b7-953a-7c6b6018b688" status: 200 len: 351 microversion: 2.1 time: 0.068585 Jul 28 09:27:55.493462 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 310/602] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/os-volumes/e33a62d1-7fd1-49b7-953a-7c6b6018b688 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:55.505501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fd836799-3538-47d1-8def-8e778af28549 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d051f9d0>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:55.594506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fd836799-3538-47d1-8def-8e778af28549 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092489 Jul 28 09:27:55.595809 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 293/603] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:55.608256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f634a7b9-68ca-4116-9b94-9726e3018700 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d05004c0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:55.694250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f634a7b9-68ca-4116-9b94-9726e3018700 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090019 Jul 28 09:27:55.694819 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 311/604] 10.222.0.23 () {58 vars in 1149 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:55.710882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-52ab2ccc-207e-4774-a685-f3b7c6dc1b87 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d05d1040>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:55.794951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-52ab2ccc-207e-4774-a685-f3b7c6dc1b87 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087686 Jul 28 09:27:55.795519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 294/605] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:27:55.806688 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7bcb8d03-dc07-4d9b-a854-2ea7f44c7560 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d04d2ca0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:55.896511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7bcb8d03-dc07-4d9b-a854-2ea7f44c7560 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093833 Jul 28 09:27:55.897251 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 312/606] 10.222.0.23 () {58 vars in 1167 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:55.910455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d407aac0-74bb-4a63-b92a-d6ca6630b8d9 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d04b9430>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:56.013608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d407aac0-74bb-4a63-b92a-d6ca6630b8d9 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.107647 Jul 28 09:27:56.014439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 295/607] 10.222.0.23 () {58 vars in 1170 bytes} [Wed Jul 28 09:27:55 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:27:56.026965 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-65c20217-e4f2-4387-ab02-2ed782e781a4 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d0f43b80>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:56.116834 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-65c20217-e4f2-4387-ab02-2ed782e781a4 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094500 Jul 28 09:27:56.117755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 313/608] 10.222.0.23 () {58 vars in 1155 bytes} [Wed Jul 28 09:27:56 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:56.130032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-19a6e60e-b0a1-4588-b5d6-67169c49eadf tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d053c1f0>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:56.218603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-19a6e60e-b0a1-4588-b5d6-67169c49eadf tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092530 Jul 28 09:27:56.219462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 296/609] 10.222.0.23 () {58 vars in 1188 bytes} [Wed Jul 28 09:27:56 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:27:56.232111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-47b2232c-4aae-4dbf-8403-56c4f45fc8f4 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] Calling method '.version_select at 0x7f16d04dc4c0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:56.317609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-47b2232c-4aae-4dbf-8403-56c4f45fc8f4 tempest-VolumesTestJSON-741738230 tempest-VolumesTestJSON-741738230-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089852 Jul 28 09:27:56.318187 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 314/610] 10.222.0.23 () {58 vars in 1155 bytes} [Wed Jul 28 09:27:56 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:27:56.461648 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:56.462277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:56.470467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:56.470919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:56.471755 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:56.472220 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:56.609373 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:56.624217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:56.632653 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:56.633919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c44d15c0-8e92-44d8-83df-2cf8a05e1419 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.176132 Jul 28 09:27:56.634474 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 297/611] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:56 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:57.657095 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:57.657873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:57.665922 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:57.666367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:57.667324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:57.668620 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:57.819392 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:57.830023 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:57.831695 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:57.833389 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bc478725-2720-43f7-8afb-fe0e131a18f0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.181460 Jul 28 09:27:57.834081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 315/612] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:57 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:27:58.852574 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:27:58.853172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:27:58.859821 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:58.860272 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:58.861054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:27:58.861544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:27:59.016897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:59.025338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:59.026890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:27:59.028445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b61d8818-29f2-4c94-8c20-194c2796a683 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.180164 Jul 28 09:27:59.029002 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 298/613] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:27:58 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:00.046225 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:00.046959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:00.053852 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:00.054411 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:00.055686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:00.056341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:00.222992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:00.232132 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:00.234025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:00.235174 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1bb36245-7c96-474a-bd8e-9e99042f2ed2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.192743 Jul 28 09:28:00.236258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 316/614] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:00 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:01.254262 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:01.255013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:01.261032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:01.262397 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:01.263327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:01.263851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:01.404263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:01.415463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:01.415463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:01.415906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9d2c8054-01a4-49cc-aa80-411f262967b5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.164923 Jul 28 09:28:01.416231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 299/615] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:01 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:28:02.436542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:02.437643 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:02.443319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:02.443943 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:02.444887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:02.445766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:02.586369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:02.595435 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:02.597167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:02.598811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-df41b97a-4d1d-4d6d-aa5d-2e0c8951699d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.166055 Jul 28 09:28:02.599789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 317/616] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:02 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:03.616941 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:03.617548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:03.624433 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:03.625043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:03.625819 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:03.626246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:03.764177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:03.776043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:03.779038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:03.780681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-90e7d218-a06e-4e95-ad10-0c04be6353e7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.167013 Jul 28 09:28:03.780773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 300/617] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:03 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:04.798385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:04.799511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:04.805609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:04.806055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:04.806817 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:04.807248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:04.943765 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:04.953090 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:04.954593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:04.955773 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c5ceeb27-3391-48ed-a0f4-eab1258f14dc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.161053 Jul 28 09:28:04.965989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 318/618] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:04 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:05.611726 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:28:05.612268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:28:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:28:05.973997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:05.974605 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:05.980287 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:05.980729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:05.982017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:05.982440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:06.108066 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:06.116169 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:06.117652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:06.118786 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6df37b23-5b66-4c28-b240-3a58cc43bd5d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.148488 Jul 28 09:28:06.119337 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 301/619] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:05 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:07.137538 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:07.137977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:07.143823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:07.144280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:07.145054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:07.145512 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:07.273832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:07.282757 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:07.284263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:07.285648 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-20f6e4cb-3e1e-475e-93a2-1fe948fb56e3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.152301 Jul 28 09:28:07.296859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 319/620] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:07 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:08.304836 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:08.305481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:08.312313 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:08.312772 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:08.313556 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:08.313994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:08.450240 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:08.470714 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:08.472017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:08.473399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0d7e8696-86e1-412d-8839-84cc753d00b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.172691 Jul 28 09:28:08.473955 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 302/621] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:08 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:09.492513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:09.493715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:09.501286 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:09.501726 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:09.502685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:09.503351 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:09.653371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:09.661666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:09.663168 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:09.664352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b7537a34-e71a-413c-81de-7e1068f3f633 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.175603 Jul 28 09:28:09.664909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 320/622] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:09 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:10.682133 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:10.682736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:10.689309 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:10.689751 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:10.690508 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:10.690937 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:10.826668 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:10.834773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:10.836299 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:10.837451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b116485b-777b-4f09-b050-cc0a2b4d9857 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.158959 Jul 28 09:28:10.837988 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 303/623] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:10 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:11.855672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:11.856272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:11.862076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:11.862558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:11.863330 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:11.863804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:11.984636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:11.992720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:11.994221 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:11.995365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-211953dd-1bcf-457a-9ad4-23ddb605a012 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.143402 Jul 28 09:28:11.996001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 321/624] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:11 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:13.014228 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:13.014828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:13.020675 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:13.021128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:13.021890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:13.022324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:13.141084 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:13.149151 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:13.150642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:13.151804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e30bb058-a5da-44ba-aa3e-7047cf40545e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.141801 Jul 28 09:28:13.152618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 304/625] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:13 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:14.170286 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:14.170829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:14.176859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:14.177304 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:14.178067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:14.178531 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:14.298833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:14.306923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:14.308456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:14.310315 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3719f5e9-4258-4e57-aa16-2954a9c75415 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.143914 Jul 28 09:28:14.310874 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 322/626] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:14 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:15.328908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:15.329514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:15.335531 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:15.336000 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:15.336754 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:15.337178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:15.460754 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:15.469158 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:15.470667 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:15.471840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6503daf4-9a75-449c-9e5a-f59d377aaff0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.147265 Jul 28 09:28:15.472405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 305/627] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:15 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:16.054850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-faed88e4-fc92-4873-a849-9deeaa262a73 req-d9df3c9d-1846-40f1-b72a-93d36050234f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "name": "network-vif-plugged", "status": "completed", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:16.056489 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:28:16.056489 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:28:16.064190 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-faed88e4-fc92-4873-a849-9deeaa262a73 req-d9df3c9d-1846-40f1-b72a-93d36050234f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:16.064653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-faed88e4-fc92-4873-a849-9deeaa262a73 req-d9df3c9d-1846-40f1-b72a-93d36050234f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:16.076462 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-faed88e4-fc92-4873-a849-9deeaa262a73 req-d9df3c9d-1846-40f1-b72a-93d36050234f service nova] Creating event network-vif-plugged:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:28:16.081448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-faed88e4-fc92-4873-a849-9deeaa262a73 req-d9df3c9d-1846-40f1-b72a-93d36050234f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030163 Jul 28 09:28:16.082385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 323/628] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:28:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:28:16.488593 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:16.489211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:16.495107 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:16.495494 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:16.496283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:16.496870 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:16.622123 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:16.630476 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:16.631997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:16.633137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b0a36668-de99-40c0-a7cb-8533d56d9cc8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.148241 Jul 28 09:28:16.633688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 306/629] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:16 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:17.652334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:17.653593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:17.659459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:17.659937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:17.660696 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:17.661121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:17.791432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:17.801271 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:17.802759 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:17.803923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a3939c97-72a5-4248-b748-d59c90faa2ea tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.155938 Jul 28 09:28:17.804473 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 324/630] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:17 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:18.821971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:18.822653 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:18.829063 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:18.829502 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:18.830258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:18.830682 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:18.966130 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:18.974984 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:18.976535 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:18.977698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b3ffb2f4-0d7c-4ef5-8998-9712f7baa043 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.160033 Jul 28 09:28:18.978298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 307/631] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:18 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:19.996146 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:19.997238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:20.003037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:20.003476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:20.004264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:20.004695 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:20.120812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:20.129389 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:20.130875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:20.132039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a40655bd-c18e-4c97-b234-8b4196ad0a85 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.139593 Jul 28 09:28:20.132601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 325/632] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:19 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:21.150011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:21.150655 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:21.156800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:21.157247 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:21.158008 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:21.158439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:21.278573 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:21.286766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:21.288303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:21.289453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-71ff18d4-9c50-4360-a6d4-9c6a1113c386 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1808 microversion: 2.20 time: 0.143178 Jul 28 09:28:21.290005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 308/633] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:21 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:22.307714 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:22.308327 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:22.314675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:22.315121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:22.315916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:22.316349 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:22.435829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:22.444278 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:22.445767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:22.446910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9995f12e-95d3-4116-bcd5-3a648b67f0a0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1795 microversion: 2.20 time: 0.142936 Jul 28 09:28:22.447680 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 326/634] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:28:22 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1795 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:28:42.879377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:42.879963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:42.886564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:42.887017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:42.887852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:42.888293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:43.022137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lazy-loading 'services' on Instance uuid a93e643c-a780-41fb-9719-43b374afe806 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:28:43.102584 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a17802d1-79d6-4ff7-8940-138f1ea6e280 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/os-volume_attachments/a980c029-1fd3-4e46-9827-5ce49fc10553" status: 202 len: 0 microversion: 2.1 time: 0.228116 Jul 28 09:28:43.103607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 309/635] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:28:42 2021] DELETE /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/os-volume_attachments/a980c029-1fd3-4e46-9827-5ce49fc10553 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:28:44.260886 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d0c8abf6-c311-4421-9f37-9322f7ca0d72 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:44.268057 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0c8abf6-c311-4421-9f37-9322f7ca0d72 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:44.270609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0c8abf6-c311-4421-9f37-9322f7ca0d72 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:44.297135 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d0c8abf6-c311-4421-9f37-9322f7ca0d72 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Going to try to stop instance {{(pid=107293) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 28 09:28:44.347669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d0c8abf6-c311-4421-9f37-9322f7ca0d72 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 202 len: 0 microversion: 2.1 time: 0.090508 Jul 28 09:28:44.348266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 327/636] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:28:44 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:28:44.357165 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:44.358464 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:44.367019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:44.367792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:44.368794 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:44.369391 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:44.514255 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:44.523486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-664e76c5-2b2b-4970-8491-b2fb2e7ad20c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.170334 Jul 28 09:28:44.524190 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 310/637] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:44 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:45.550813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:45.551478 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:45.558031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:45.558478 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:45.559464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:45.559949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:45.708418 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:45.716214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-14533645-3f10-4dbf-9ed9-5429f86f45d8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.177684 Jul 28 09:28:45.728316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 328/638] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:45 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:46.738135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:46.739661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:46.746007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:46.746007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:46.747339 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:46.748178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:46.895560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:46.903852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-06328e5a-e8f4-40a2-8c6c-b842b1f25761 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.170724 Jul 28 09:28:46.904924 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 311/639] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:46 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:47.920830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:47.921647 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:47.927958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:47.928397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:47.929209 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:47.929637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:48.073891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:48.082652 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-de6b0aea-e988-46bd-84d7-e4080d30370e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.165474 Jul 28 09:28:48.083233 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 329/640] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:47 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:48.555522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1938c291-d1e6-4e7d-a5db-5ce13379c522 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Action: 'create', calling method: .version_select at 0x7f16d051f280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1130295792"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:48.575486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-1938c291-d1e6-4e7d-a5db-5ce13379c522 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Getting quotas for project de7108c357a549b0a779fe9c24380ee8. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:28:48.580199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-1938c291-d1e6-4e7d-a5db-5ce13379c522 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Getting quotas for user 3933a41da6e34894829b2b4028ef6005 and project de7108c357a549b0a779fe9c24380ee8. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:28:48.798416 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-1938c291-d1e6-4e7d-a5db-5ce13379c522 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Getting quotas for project de7108c357a549b0a779fe9c24380ee8. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:28:48.802410 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-1938c291-d1e6-4e7d-a5db-5ce13379c522 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Getting quotas for user 3933a41da6e34894829b2b4028ef6005 and project de7108c357a549b0a779fe9c24380ee8. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:28:48.815510 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1938c291-d1e6-4e7d-a5db-5ce13379c522 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.263602 Jul 28 09:28:48.816141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 312/641] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jul 28 09:28:48 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:48.951763 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2112044408", "imageRef": "b90cef35-7b31-4b95-9271-4896d6117594", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1130295792", "networks": [{"uuid": "5c151ff0-f69c-4429-8612-95745316e0b4"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:49.005629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] validate_networks() for [('5c151ff0-f69c-4429-8612-95745316e0b4', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:28:49.099815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:49.100431 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:49.106075 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:49.106515 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:49.107275 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:49.107729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:49.322099 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:49.330612 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-838aff96-4c8b-4e06-a7eb-6c1087ddd84a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.234435 Jul 28 09:28:49.331181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 313/642] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:49 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:28:49.439876 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:28:49.440366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:28:49.440838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:28:49.441242 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:28:49.441870 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:28:49.451812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:49.452259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:49.453093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:49.453524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:49.470675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Getting quotas for project de7108c357a549b0a779fe9c24380ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:28:49.474601 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Getting quotas for user 3933a41da6e34894829b2b4028ef6005 and project de7108c357a549b0a779fe9c24380ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:28:49.485916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:28:49.488192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b90cef35-7b31-4b95-9271-4896d6117594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:28:49.535717 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7d3660e7-9ee6-4a2c-a01a-b9277ec05c43 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587603 Jul 28 09:28:49.536288 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 330/643] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:28:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:28:49.546884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-032df946-37b9-486d-9673-1fc7d8a5c042 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:49.547632 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-032df946-37b9-486d-9673-1fc7d8a5c042 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:49.602576 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-032df946-37b9-486d-9673-1fc7d8a5c042 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:49.609702 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-032df946-37b9-486d-9673-1fc7d8a5c042 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1259 microversion: 2.1 time: 0.067176 Jul 28 09:28:49.610300 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 314/644] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:49 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:50.347659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:50.348192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:50.354076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:50.354513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:50.355265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:50.355722 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:50.532896 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:50.541642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b4fb7957-8f5f-4751-b3e8-3712212f97d6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.197693 Jul 28 09:28:50.542284 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 331/645] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:50 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:28:50.626539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:50.627287 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:50.633058 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:50.633499 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:50.634265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:50.634692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:50.701223 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:50.709132 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d49277e7-a6ae-4cca-b110-21a2873a47ad tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1317 microversion: 2.1 time: 0.086827 Jul 28 09:28:50.709689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 315/646] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:50 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1317 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:28:51.559122 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:51.559765 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:51.566384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:51.566829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:51.567595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:51.568032 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:51.692436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:51.700065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a39b8cd6-dae0-43c0-b620-713f5a7e4bf8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.144111 Jul 28 09:28:51.704900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 332/647] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:51 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:51.726891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:51.727541 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:51.733758 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:51.734207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:51.734975 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:51.735412 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:51.858442 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:51.865579 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fda427b3-401f-4d2c-a830-c45a78f89b3c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.142597 Jul 28 09:28:51.866137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 316/648] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:51 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:52.716172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:52.716788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:52.723349 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:52.723826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:52.724598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:52.725028 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:52.846656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:52.853903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-69266ee4-bbc5-49c0-97a3-6f6ff8c2015a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.141382 Jul 28 09:28:52.854464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 333/649] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:52 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:52.882225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:52.882834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:52.888602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:52.889605 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:52.890375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:52.890807 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:53.008113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:53.015804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8348d718-e9e9-433c-b070-72f9224c5601 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.137152 Jul 28 09:28:53.016368 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 317/650] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:52 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:53.869901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:53.870510 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:53.877183 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:53.877637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:53.878408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:53.878842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:54.032467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:54.033057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:54.046644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:54.047399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:54.048447 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:54.049083 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:54.293379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:54.304033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4210ced0-8210-46b3-800e-4e29e5b2ef89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.437524 Jul 28 09:28:54.309011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 334/651] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:53 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:54.364242 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:54.390642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fd36f0f5-7a5a-4719-809b-badfc49c8a09 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.361828 Jul 28 09:28:54.393445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 318/652] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:54 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:54.693982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-bea5d4ad-d5eb-4565-989c-fbcf68338995 req-abeca2f4-da9c-4982-a797-e9a7aa2d7f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:28:54.697007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:28:54.697007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:28:54.723836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-bea5d4ad-d5eb-4565-989c-fbcf68338995 req-abeca2f4-da9c-4982-a797-e9a7aa2d7f09 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:54.724317 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-bea5d4ad-d5eb-4565-989c-fbcf68338995 req-abeca2f4-da9c-4982-a797-e9a7aa2d7f09 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:54.772845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-bea5d4ad-d5eb-4565-989c-fbcf68338995 req-abeca2f4-da9c-4982-a797-e9a7aa2d7f09 service nova] Creating event network-changed:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:28:54.778365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-bea5d4ad-d5eb-4565-989c-fbcf68338995 req-abeca2f4-da9c-4982-a797-e9a7aa2d7f09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088090 Jul 28 09:28:54.779099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 335/653] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:28:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:28:55.321530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:55.322139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:55.328265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.328734 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.329503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.329957 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.409380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:55.410066 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:55.416266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.416708 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.417473 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.417897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.484657 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:55.492178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f0673d7e-8af2-4a34-b4bf-cc4ce1ad11b6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.174313 Jul 28 09:28:55.492761 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 319/654] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:55 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:55.566596 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:55.573970 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3ead9de9-6a0f-400c-998e-1331f0b245b2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.169591 Jul 28 09:28:55.574545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 336/655] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:55 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:28:55.839969 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:55.840386 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:55.847189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.847764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.848564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.849004 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.881181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-96812a8a-ec0f-4a30-a19a-589baab43e2a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-volume_attachments/12e1d3c7-2dc0-4a13-b803-ff307eeb5892" status: 200 len: 194 microversion: 2.20 time: 0.045043 Jul 28 09:28:55.886912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 320/656] 10.222.0.23 () {60 vars in 1454 bytes} [Wed Jul 28 09:28:55 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-volume_attachments/12e1d3c7-2dc0-4a13-b803-ff307eeb5892 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:28:55.950153 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:55.950934 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:55.957901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.958354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:55.959332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:55.959800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:56.048989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lazy-loading 'services' on Instance uuid 1770556b-7187-418c-9c5e-6f6652a8f4c3 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:28:56.112151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6f8a8b6e-274f-4aa3-96ba-a21c858183c9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-volume_attachments/12e1d3c7-2dc0-4a13-b803-ff307eeb5892" status: 202 len: 0 microversion: 2.20 time: 0.165586 Jul 28 09:28:56.112732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 337/657] 10.222.0.23 () {60 vars in 1457 bytes} [Wed Jul 28 09:28:55 2021] DELETE /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3/os-volume_attachments/12e1d3c7-2dc0-4a13-b803-ff307eeb5892 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:28:56.509015 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:56.509634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:56.515683 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:56.516134 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:56.516921 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:56.517350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:56.592657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:56.593498 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:56.604272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:56.604883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:56.605997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:56.606456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:56.708488 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:56.716503 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3f9b1a97-62d9-430c-89dc-d9293978a972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.211038 Jul 28 09:28:56.727988 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 321/658] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:56 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:56.782231 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:56.790187 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e067c3bd-6467-4b96-b87d-0bdc180c047e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.202121 Jul 28 09:28:56.791027 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 338/659] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:56 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:28:57.735032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:57.735789 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:57.742795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:57.743320 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:57.744311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:57.744922 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:57.808121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:57.808730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:57.815697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:57.816144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:57.823707 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:57.824189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:57.955936 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:57.964800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e9e4f446-d2db-4ba8-abcf-a5e2583a302f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.233694 Jul 28 09:28:57.968674 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 322/660] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:57 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:58.028499 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:58.037821 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b349d500-6f83-4705-b623-3e512d982835 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.233779 Jul 28 09:28:58.039189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 339/661] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:57 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:28:58.986346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:58.988172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:58.996418 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:58.997207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:58.999158 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:58.999876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:59.056879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:28:59.057484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:28:59.064438 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:59.064886 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:59.065830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:28:59.066591 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:28:59.247533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:59.259053 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-26b1cfba-3b43-4c3c-812d-792fe404ba62 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.276400 Jul 28 09:28:59.271113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 323/662] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:58 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:28:59.311406 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:28:59.320872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cfec1c80-0fed-4851-b840-4cfa14b88039 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.267473 Jul 28 09:28:59.324027 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 340/663] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:28:59 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:00.278611 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:00.280857 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:00.287981 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:00.288434 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:00.289210 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:00.289640 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:00.346502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:00.348813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:00.357784 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:00.359013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:00.360499 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:00.377813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:00.523524 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:00.534527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b418c415-c147-4971-90d5-8baf45587264 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.260721 Jul 28 09:29:00.546635 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 324/664] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:00 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:00.620863 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:00.629089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-48cf9b51-4f88-4a96-8530-61739e2f2327 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.291693 Jul 28 09:29:00.630670 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 341/665] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:00 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:01.552965 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:01.553698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:01.559947 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:01.561407 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:01.562319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:01.563025 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:01.650053 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:01.650885 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:01.659013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:01.659477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:01.670928 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:01.671393 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:01.718712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:01.736973 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-973d665b-5999-45c2-a233-c5810e335a3c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.187789 Jul 28 09:29:01.738180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 325/666] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:01 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:01.880354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:01.887947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4424828e-4153-4f3d-a624-c57cb458aee4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.243349 Jul 28 09:29:01.889033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 342/667] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:01 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:02.754746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:02.755445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:02.763109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:02.763731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:02.764602 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:02.765111 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:02.916042 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:02.917439 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:02.925088 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:02.927749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:02.927749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:02.927749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:03.013181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:03.034408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-053499d9-c620-4c57-8e83-722b19336cd0 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.283021 Jul 28 09:29:03.035010 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 326/668] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:02 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:03.165959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:03.174980 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-68f70002-60c9-4e90-9d30-c2c7c8188980 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.271649 Jul 28 09:29:03.187942 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 343/669] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:02 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:04.052045 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:04.052664 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:04.058729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:04.059177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:04.059964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:04.061276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:04.186944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:04.195172 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-72e2d4b6-ac42-4335-934c-17b2c231b238 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.146713 Jul 28 09:29:04.195793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 327/670] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:04 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:04.196196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:04.196859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:04.203259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:04.203951 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:04.204734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:04.205167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:04.352159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:04.368101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-38f2bfb7-7300-48db-961b-12c6a55a0a94 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.176143 Jul 28 09:29:04.378900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 344/671] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:04 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:05.212752 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:05.213361 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:05.220141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:05.220592 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:05.221403 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:05.221959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:05.385833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:05.386438 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:05.393902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:05.394531 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:05.395425 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:05.395884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:05.944379 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:05.964277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-15974df6-a49d-4d16-a7e5-ed50960f7321 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1679 microversion: 2.1 time: 0.755187 Jul 28 09:29:05.974413 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 328/672] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:05 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1679 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:05.980449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:05.981970 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:05.989021 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:05.990301 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:05.991419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:05.992043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:06.009521 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:06.019905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5565d9e6-2ab8-4b79-bd17-b35ef9660cd3 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.637648 Jul 28 09:29:06.028404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 345/673] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:05 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:06.036921 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:29:06.131487 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5134ee73-6d9c-43c7-83a0-8da9ee663ba8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 204 len: 0 microversion: 2.20 time: 0.155241 Jul 28 09:29:06.132203 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 329/674] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Jul 28 09:29:05 2021] DELETE /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:29:06.141439 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:06.142577 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:06.148770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:06.149465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:06.150174 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:06.150705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:06.372266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:06.380744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:06.382258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:06.383407 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-da980417-6a20-4046-8e3f-75980671040e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.246743 Jul 28 09:29:06.384004 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 346/675] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:06 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:06.981592 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:06.982956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:06.988925 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:06.989372 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:06.990142 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:06.990577 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.037701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:07.038320 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:07.044215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.045263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.046151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.046586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.151689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:07.160004 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-590f6d37-277a-4322-b012-859236d38738 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1656 microversion: 2.1 time: 0.182372 Jul 28 09:29:07.167465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 330/676] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:06 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1656 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:07.175656 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-429c53e4-9545-4a8a-94b1-2506e14f4f73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:07.181474 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-429c53e4-9545-4a8a-94b1-2506e14f4f73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.182182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-429c53e4-9545-4a8a-94b1-2506e14f4f73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.210722 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-429c53e4-9545-4a8a-94b1-2506e14f4f73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Going to try to start instance {{(pid=107292) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 28 09:29:07.210858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:07.217962 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-dafa31eb-efc7-4b7a-ba80-3a3d2ea3bde5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.183582 Jul 28 09:29:07.226543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 347/677] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:07 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:07.250143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-429c53e4-9545-4a8a-94b1-2506e14f4f73 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action" status: 202 len: 0 microversion: 2.1 time: 0.077716 Jul 28 09:29:07.250902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 331/678] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:29:07 2021] POST /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:29:07.261026 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:07.261744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:07.268514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.268953 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.269786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.270226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.401839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:07.402797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:07.409437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.409880 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.410888 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:07.411316 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:07.448185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:07.457546 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f2dbb6df-3e12-4ef0-b66f-7ffaf55f7c7b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1665 microversion: 2.1 time: 0.202245 Jul 28 09:29:07.467805 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 348/679] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:07 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1665 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:07.650867 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:07.660697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:07.662350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:07.663512 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-64a2a797-f078-45e0-a77e-943939644f34 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1723 microversion: 2.20 time: 0.265730 Jul 28 09:29:07.669084 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 332/680] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:07 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:29:08.234828 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:08.235449 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:08.241373 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:08.241823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:08.242603 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:08.245346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:08.474585 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:08.475831 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:08.476456 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:08.482332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:08.482933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:08.484113 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:08.484779 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:08.488508 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4a01a3f3-2e27-427a-bc99-99c9b55e9530 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.257805 Jul 28 09:29:08.502589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 349/681] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:08 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:08.677029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:08.686259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:08.687142 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6286717d-7cc0-4c71-a54a-83c0e861d2d4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1665 microversion: 2.1 time: 0.216493 Jul 28 09:29:08.687643 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:08.696308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:08.697279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:08.698328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:08.699040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:08.706460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 333/682] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:08 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:08.809810 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:08.818275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:08.819769 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:08.820994 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-794bfe88-4b24-43d7-adf3-5973c4f1ebad tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1655 microversion: 2.20 time: 0.142326 Jul 28 09:29:08.832518 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 350/683] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:08 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:29:09.340286 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-d321fd6e-b854-493f-94bb-349c52745c1a req-ca9b340e-8f0a-469e-aacb-8453a0208eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1770556b-7187-418c-9c5e-6f6652a8f4c3", "name": "network-vif-deleted", "tag": "783c4c2d-0e20-455d-97a1-49611ff7ea66"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:09.342284 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:09.342284 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:29:09.350284 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-d321fd6e-b854-493f-94bb-349c52745c1a req-ca9b340e-8f0a-469e-aacb-8453a0208eba service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.350999 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-d321fd6e-b854-493f-94bb-349c52745c1a req-ca9b340e-8f0a-469e-aacb-8453a0208eba service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.363909 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-d321fd6e-b854-493f-94bb-349c52745c1a req-ca9b340e-8f0a-469e-aacb-8453a0208eba service nova] Creating event network-vif-deleted:783c4c2d-0e20-455d-97a1-49611ff7ea66 for instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 on hv-cinder-80266 Jul 28 09:29:09.369137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-d321fd6e-b854-493f-94bb-349c52745c1a req-ca9b340e-8f0a-469e-aacb-8453a0208eba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Jul 28 09:29:09.370128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 334/684] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:09.507674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:09.509582 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:09.516891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.517342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.518161 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.519189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.723801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:09.725068 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:09.754480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.754927 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.757042 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.758357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.765367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:09.776824 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-12bd368a-d062-44a7-8f17-e52053022216 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.270453 Jul 28 09:29:09.779692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 351/685] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:09 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:09.840802 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:09.847490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:09.865360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.866316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.868602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.871746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.931222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:09.931693 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:09.932143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lazy-loading 'fault' on Instance uuid 1770556b-7187-418c-9c5e-6f6652a8f4c3 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:29:10.015611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:10.029607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:10.033207 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:10.037152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:10.038420 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4e7a4f80-2806-4be8-8c6d-1551a9fa9835 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 200 len: 1370 microversion: 2.20 time: 0.201465 Jul 28 09:29:10.039001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 352/686] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:09 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:10.043670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-260e26db-c9aa-4094-82c3-a5aa0af2b9e7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1669 microversion: 2.1 time: 0.323210 Jul 28 09:29:10.043670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 335/687] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:09 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1669 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:10.799077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:10.799729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:10.805883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:10.806448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:10.807441 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:10.808227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:10.944145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:10.951877 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1c171e28-2016-403c-ac95-bed1805b8bdc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.157371 Jul 28 09:29:10.952444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 353/688] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:10 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:11.058877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:11.059588 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:11.065985 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:11.066420 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:11.067225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:11.067678 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:11.080508 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] HTTP exception thrown: Instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 could not be found. Jul 28 09:29:11.081087 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Returning 404 to user: Instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:29:11.081900 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-643dcaf2-d900-4821-8cff-f74cf21a8968 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 404 len: 111 microversion: 2.20 time: 0.026778 Jul 28 09:29:11.082424 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 336/689] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:11 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 09:29:11.090633 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-309b88a2-c265-49df-b9e4-2a183366689f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '.version_select at 0x7f16d0fe0310>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:11.111459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-309b88a2-c265-49df-b9e4-2a183366689f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673955249" status: 204 len: 0 microversion: 2.20 time: 0.024347 Jul 28 09:29:11.112068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 354/690] 10.222.0.23 () {60 vars in 1259 bytes} [Wed Jul 28 09:29:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673955249 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 09:29:11.793839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-98c13f8d-d074-4171-88ac-ff8b335e886f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'create', calling method: .version_select at 0x7f16d04b9280>, body: {"keypair": {"name": "tempest-keypair-1692697247"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:11.814646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-98c13f8d-d074-4171-88ac-ff8b335e886f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:29:11.818483 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-98c13f8d-d074-4171-88ac-ff8b335e886f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for user 4ccc60eb94ea47cc9dfa5f5240c16263 and project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:29:11.907540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-f5169630-a463-46ea-bba4-2f55ea4a8d1a req-5ee23dc0-7652-4f81-9d95-1754b715859c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "name": "network-vif-plugged", "status": "completed", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:11.911432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:11.911432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:11.920622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-f5169630-a463-46ea-bba4-2f55ea4a8d1a req-5ee23dc0-7652-4f81-9d95-1754b715859c service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:11.921118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-f5169630-a463-46ea-bba4-2f55ea4a8d1a req-5ee23dc0-7652-4f81-9d95-1754b715859c service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:11.932967 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-f5169630-a463-46ea-bba4-2f55ea4a8d1a req-5ee23dc0-7652-4f81-9d95-1754b715859c service nova] Creating event network-vif-plugged:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:29:11.939231 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-f5169630-a463-46ea-bba4-2f55ea4a8d1a req-5ee23dc0-7652-4f81-9d95-1754b715859c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Jul 28 09:29:11.939883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 355/691] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:29:11.970705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:11.973365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:11.980400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:11.980851 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:11.981645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:11.982118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:12.158090 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:12.165816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-606d55fe-f6aa-4ef3-8f22-ad04830e51b5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1359 microversion: 2.1 time: 0.200806 Jul 28 09:29:12.166683 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 356/692] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:11 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:12.263610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-98c13f8d-d074-4171-88ac-ff8b335e886f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:29:12.267257 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-98c13f8d-d074-4171-88ac-ff8b335e886f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for user 4ccc60eb94ea47cc9dfa5f5240c16263 and project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:29:12.280082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-98c13f8d-d074-4171-88ac-ff8b335e886f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.490023 Jul 28 09:29:12.280667 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 337/693] 10.222.0.23 () {62 vars in 1199 bytes} [Wed Jul 28 09:29:11 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 491 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:29:13.182121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:13.182757 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:13.189252 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.189697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.190470 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.190891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.314664 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:13.322001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cca4b8e8-d369-49e1-86e8-ad39e2df217e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1549 microversion: 2.1 time: 0.143644 Jul 28 09:29:13.322687 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 357/694] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:13 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1549 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:13.337534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:13.338244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:13.344449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.344977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.345827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.346333 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.487325 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:13.494918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-04dc52ab-d68c-4c6f-b52e-f865391656a5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1549 microversion: 2.1 time: 0.160914 Jul 28 09:29:13.495622 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 338/695] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:13 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:13.510622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:13.514102 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:13.514102 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:13.515097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:13.515863 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Searching by: {'deleted': False, 'project_id': 'de7108c357a549b0a779fe9c24380ee8'} {{(pid=107293) get_all /opt/stack/nova/nova/compute/api.py:2833}} Jul 28 09:29:13.522378 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.523022 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.523995 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.524586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.574114 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-32345184", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59c4a637-5ed0-4b6e-a037-96ec97ce270f"}], "security_groups": [{"name": "tempest-securitygroup--1977864816"}], "key_name": "tempest-keypair-1692697247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:13.617839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.multi_cell_list [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107293) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 28 09:29:13.678468 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] validate_networks() for [('59c4a637-5ed0-4b6e-a037-96ec97ce270f', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:29:13.720976 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-023f54b0-f775-4fc4-a297-97c39d27befe tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213891 Jul 28 09:29:13.721921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 358/696] 10.222.0.23 () {58 vars in 1125 bytes} [Wed Jul 28 09:29:13 2021] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:13.732888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:13.733771 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:13.740909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.741413 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.742277 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:13.742848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:13.925811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:13.936629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e028c21a-0973-44cd-81b3-825d9bfac1af tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1549 microversion: 2.1 time: 0.208822 Jul 28 09:29:13.937669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 359/697] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:13 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:14.223788 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:29:14.224833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:29:14.226545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:29:14.227186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:29:14.227874 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:29:14.239932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:14.240672 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:14.241642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:14.242238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:14.272851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:29:14.281200 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Getting quotas for user 4ccc60eb94ea47cc9dfa5f5240c16263 and project b8340ca8a0bb47c3871a9e4d939e9a44. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:29:14.299944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:29:14.302873 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:29:14.352012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-aaabf6c7-5b82-4b70-a02b-8f838719e6df tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.781701 Jul 28 09:29:14.353150 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 339/698] 10.222.0.23 () {62 vars in 1188 bytes} [Wed Jul 28 09:29:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 09:29:14.363558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f7a78a12-09bb-4e18-9fd7-6f6da15058e6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:14.364766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f7a78a12-09bb-4e18-9fd7-6f6da15058e6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:14.431323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f7a78a12-09bb-4e18-9fd7-6f6da15058e6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:14.439005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f7a78a12-09bb-4e18-9fd7-6f6da15058e6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:14.440901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f7a78a12-09bb-4e18-9fd7-6f6da15058e6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:14.442243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f7a78a12-09bb-4e18-9fd7-6f6da15058e6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1280 microversion: 2.20 time: 0.082590 Jul 28 09:29:14.452844 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 360/699] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:14 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:15.461060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:15.462453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:15.471125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:15.471893 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:15.473122 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:15.473753 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:15.519128 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "063ff76d-87a8-4081-bd0a-bdd9b8139ea7"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:15.520337 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:15.530404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:15.531126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:15.532192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:15.533026 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:15.571981 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:15.583324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:15.585656 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:15.587230 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9dd341c8-1741-4989-a645-9f97dbe9d8fb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1338 microversion: 2.20 time: 0.130932 Jul 28 09:29:15.588324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 340/700] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:15 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1338 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:15.830760 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bc0bda8a-f0d1-4980-974e-fe2d937ad3e4 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314413 Jul 28 09:29:15.837923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 361/701] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:29:15 2021] POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:16.605730 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:16.607809 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:16.613669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:16.614117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:16.615081 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:16.615534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:16.837389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:16.862038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:16.863821 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:16.865006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b6dd0ba1-0d16-4e7d-8f52-36adf1f93c7b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1406 microversion: 2.20 time: 0.263149 Jul 28 09:29:16.871623 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 341/702] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:16 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:17.086540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-5ef525f4-9d3a-45af-af79-4e0dbdf7e62e req-720c6451-204c-4fb5-ba00-d77c4c6e9ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:17.089720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:17.089720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:17.100555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5ef525f4-9d3a-45af-af79-4e0dbdf7e62e req-720c6451-204c-4fb5-ba00-d77c4c6e9ddf service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:17.100999 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-5ef525f4-9d3a-45af-af79-4e0dbdf7e62e req-720c6451-204c-4fb5-ba00-d77c4c6e9ddf service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:17.112711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-5ef525f4-9d3a-45af-af79-4e0dbdf7e62e req-720c6451-204c-4fb5-ba00-d77c4c6e9ddf service nova] Creating event network-changed:9b6651ac-a2a9-45c2-85c4-d67031aa172a for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 on hv-cinder-80266 Jul 28 09:29:17.117622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-5ef525f4-9d3a-45af-af79-4e0dbdf7e62e req-720c6451-204c-4fb5-ba00-d77c4c6e9ddf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035670 Jul 28 09:29:17.118570 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 362/703] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:17.474451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-969991229", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "8a24e155-c32e-4f22-a846-e3c555ee716a"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:17.531477 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] validate_networks() for [('8a24e155-c32e-4f22-a846-e3c555ee716a', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:29:17.882644 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:17.883602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:17.890767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:17.891426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:17.892246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:17.892685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:18.156448 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:29:18.156949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:29:18.157373 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:29:18.157801 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:29:18.158229 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:29:18.167131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:18.167633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:18.168442 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:18.168932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:18.176348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:18.187710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Getting quotas for project 3fc892898a594e59889bda5edf6fe6fa. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:29:18.192473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Getting quotas for user d0395bff7c5848619b07ca4faf704ae4 and project 3fc892898a594e59889bda5edf6fe6fa. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:29:18.192673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:18.194167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:18.195488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-676535ad-c8a0-49f0-bb0c-3b798a56f94e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1406 microversion: 2.20 time: 0.316885 Jul 28 09:29:18.205995 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 363/704] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:17 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:18.206206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:29:18.208425 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:29:18.261886 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b043a728-62ec-474c-8a55-8cbe44efb90d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791185 Jul 28 09:29:18.267992 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 342/705] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:29:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:29:18.273275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c1c73074-83e1-4da8-90d5-792a92367e78 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:18.274105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c1c73074-83e1-4da8-90d5-792a92367e78 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:18.335056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c1c73074-83e1-4da8-90d5-792a92367e78 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:18.343051 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c1c73074-83e1-4da8-90d5-792a92367e78 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1218 microversion: 2.1 time: 0.073671 Jul 28 09:29:18.344395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 364/706] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:18 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:19.211894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d6a213-4f50-4b3a-9710-c704a296fd53] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 09:29:19.216032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:19.216907 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:19.223057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:19.223728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:19.224510 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:19.224949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:19.362302 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:19.363075 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:19.369977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:19.370674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:19.371523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:19.372975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:19.614622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:19.621751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b1784b15-6fe4-4ef7-bcea-eca005ce0af0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1276 microversion: 2.1 time: 0.263248 Jul 28 09:29:19.622359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 365/707] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:19 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:19.705718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:19.713842 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:19.716272 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:19.717745 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-98485a58-d386-4fba-9921-065589ea15a7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1406 microversion: 2.20 time: 0.507380 Jul 28 09:29:19.718318 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 343/708] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:19 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:20.638032 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:20.638666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:20.644370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:20.644823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:20.645780 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:20.646390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:20.735951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:20.736557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:20.755208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:20.755697 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:20.756485 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:20.756949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:20.774484 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d6a213-4f50-4b3a-9710-c704a296fd53] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40006. Jul 28 09:29:20.886029 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:20.897347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-60144189-b65a-4268-bc13-1cf18a9ecc64 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1318 microversion: 2.1 time: 0.262689 Jul 28 09:29:20.897723 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 366/709] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:20 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:20.912103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-62298e42-53ab-4957-bb17-9c42890c1aa1 req-90002900-affc-48f4-9905-3dcc2a7781d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46e2d206-3f5b-4f95-aa68-f85c12f23d1c", "tag": "6f7ebd84-ae8e-4b9f-95d6-e4a3e913639b"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:20.913798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:20.913798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:20.922104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-62298e42-53ab-4957-bb17-9c42890c1aa1 req-90002900-affc-48f4-9905-3dcc2a7781d7 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:20.922697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-62298e42-53ab-4957-bb17-9c42890c1aa1 req-90002900-affc-48f4-9905-3dcc2a7781d7 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:20.940636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-62298e42-53ab-4957-bb17-9c42890c1aa1 req-90002900-affc-48f4-9905-3dcc2a7781d7 service nova] Creating event network-changed:6f7ebd84-ae8e-4b9f-95d6-e4a3e913639b for instance 46e2d206-3f5b-4f95-aa68-f85c12f23d1c on hv-cinder-80266 Jul 28 09:29:20.945552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-62298e42-53ab-4957-bb17-9c42890c1aa1 req-90002900-affc-48f4-9905-3dcc2a7781d7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036858 Jul 28 09:29:20.946159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 367/710] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:21.020227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:21.028849 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:21.030375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:21.031449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8a449d0d-75ce-4e61-b230-4928963cdaa7 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1406 microversion: 2.20 time: 0.300090 Jul 28 09:29:21.032029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 344/711] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:20 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:29:21.914445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:21.915153 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:21.923060 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:21.923920 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:21.925084 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:21.925761 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:21.970026 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-c0cbd74e-d1d7-437c-b1a3-14f42b600a96 req-49edffad-4b95-4782-a4d5-b7efdbd2f09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "name": "network-vif-plugged", "status": "completed", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:21.976689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:21.976689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:29:21.986650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-c0cbd74e-d1d7-437c-b1a3-14f42b600a96 req-49edffad-4b95-4782-a4d5-b7efdbd2f09f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:21.987210 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-c0cbd74e-d1d7-437c-b1a3-14f42b600a96 req-49edffad-4b95-4782-a4d5-b7efdbd2f09f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:22.008736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-c0cbd74e-d1d7-437c-b1a3-14f42b600a96 req-49edffad-4b95-4782-a4d5-b7efdbd2f09f service nova] Creating event network-vif-plugged:9b6651ac-a2a9-45c2-85c4-d67031aa172a for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 on hv-cinder-80266 Jul 28 09:29:22.016064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-c0cbd74e-d1d7-437c-b1a3-14f42b600a96 req-49edffad-4b95-4782-a4d5-b7efdbd2f09f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049988 Jul 28 09:29:22.017011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 345/712] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:22.056980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:22.058005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:22.065510 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:22.066459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:22.067767 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:22.068119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:22.129964 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:22.143127 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cefdd040-193a-4395-ab6f-c3bcd2f1f2f2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1318 microversion: 2.1 time: 0.232262 Jul 28 09:29:22.145306 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 368/713] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:21 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:22.285127 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:22.295399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:22.297278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:22.298483 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-af93b606-e39a-496e-a582-f2b599902979 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1406 microversion: 2.20 time: 0.250818 Jul 28 09:29:22.299292 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 346/714] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:22 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:23.160554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:23.161155 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:23.167066 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.167506 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.168288 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.168772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.293296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:23.301215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e3222205-49a8-4119-98b9-badb1581fe37 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1318 microversion: 2.1 time: 0.144271 Jul 28 09:29:23.301783 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 369/715] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:23 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:23.316267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:23.316873 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:23.322498 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.322940 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.323724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.324161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.448785 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:23.457384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:23.457992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:23.458135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:23.459615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:23.460806 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f4134951-0e02-4d8a-a6e2-ac90a7fbd96b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1598 microversion: 2.20 time: 0.148107 Jul 28 09:29:23.461364 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 347/716] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:29:23 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1598 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:23.464654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.465100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.466005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.466394 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.477583 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:23.478082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:23.484049 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.484496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.485268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:23.485702 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:23.601838 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6e191c2c-8b79-43ce-b354-cf12d673c57b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127758 Jul 28 09:29:23.602457 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 348/717] 10.222.0.23 () {60 vars in 1316 bytes} [Wed Jul 28 09:29:23 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:29:23.630506 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:23.638299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6c4b1e55-da46-4574-932d-a7a3c2b03a1d tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1595 microversion: 2.1 time: 0.184507 Jul 28 09:29:23.638858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 370/718] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:23 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1595 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:24.318432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:24.319923 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:24.326556 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:24.327291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:24.328465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:24.329481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:24.564173 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:24.565764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:24.572019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:24.572532 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:24.573457 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:24.573993 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:24.584224 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:24.595614 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-260e00b6-98ff-45fa-b157-dddfec6ad8f7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1318 microversion: 2.1 time: 0.281054 Jul 28 09:29:24.596397 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 349/719] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:24 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:24.600607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-507a1713-7fe8-4e87-87ca-5c2a6e507952 req-fa9f914a-4015-4002-a27c-e104bbca6f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:24.602094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:24.602094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:29:24.609538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-507a1713-7fe8-4e87-87ca-5c2a6e507952 req-fa9f914a-4015-4002-a27c-e104bbca6f67 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:24.609979 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-507a1713-7fe8-4e87-87ca-5c2a6e507952 req-fa9f914a-4015-4002-a27c-e104bbca6f67 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:24.621491 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-507a1713-7fe8-4e87-87ca-5c2a6e507952 req-fa9f914a-4015-4002-a27c-e104bbca6f67 service nova] Creating event network-changed:9b6651ac-a2a9-45c2-85c4-d67031aa172a for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 on hv-cinder-80266 Jul 28 09:29:24.626982 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-507a1713-7fe8-4e87-87ca-5c2a6e507952 req-fa9f914a-4015-4002-a27c-e104bbca6f67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029621 Jul 28 09:29:24.627797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 350/720] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:24.666130 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1b38de11-51e3-42de-bc67-22b2220b278e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.106932 Jul 28 09:29:24.667297 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 371/721] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:24 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:25.613408 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:25.614106 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:25.620707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:25.621153 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:25.622714 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:25.623486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:25.678961 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:25.680507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:25.689081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:25.689746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:25.691055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:25.691613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:25.765028 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-089e9348-9343-4138-b7fe-1740dc7db49f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.089997 Jul 28 09:29:25.765686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 372/722] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:25 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:25.960135 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-523f2d17-b4a1-4930-887e-b0ab86bed295 req-743e9b17-9bb0-404b-953c-214ce5c48432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e2d206-3f5b-4f95-aa68-f85c12f23d1c", "name": "network-vif-plugged", "status": "completed", "tag": "6f7ebd84-ae8e-4b9f-95d6-e4a3e913639b"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:25.961780 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:25.961780 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:25.970402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-523f2d17-b4a1-4930-887e-b0ab86bed295 req-743e9b17-9bb0-404b-953c-214ce5c48432 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:25.970945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-523f2d17-b4a1-4930-887e-b0ab86bed295 req-743e9b17-9bb0-404b-953c-214ce5c48432 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:25.983082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-523f2d17-b4a1-4930-887e-b0ab86bed295 req-743e9b17-9bb0-404b-953c-214ce5c48432 service nova] Creating event network-vif-plugged:6f7ebd84-ae8e-4b9f-95d6-e4a3e913639b for instance 46e2d206-3f5b-4f95-aa68-f85c12f23d1c on hv-cinder-80266 Jul 28 09:29:25.988068 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-523f2d17-b4a1-4930-887e-b0ab86bed295 req-743e9b17-9bb0-404b-953c-214ce5c48432 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Jul 28 09:29:25.988780 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 373/723] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:26.048313 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:26.057992 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ca13b2b5-0220-4777-899a-f64e9d104915 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1318 microversion: 2.1 time: 0.448539 Jul 28 09:29:26.058575 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 351/724] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:25 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:26.284306 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-8f2af316-c868-418d-951d-f93f6c273d30 req-488ccf09-03d3-4ffd-bce5-3a7442bb950f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:26.285796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:26.285796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:26.292931 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8f2af316-c868-418d-951d-f93f6c273d30 req-488ccf09-03d3-4ffd-bce5-3a7442bb950f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:26.293360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-8f2af316-c868-418d-951d-f93f6c273d30 req-488ccf09-03d3-4ffd-bce5-3a7442bb950f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:26.304165 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-8f2af316-c868-418d-951d-f93f6c273d30 req-488ccf09-03d3-4ffd-bce5-3a7442bb950f service nova] Creating event network-changed:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:29:26.308974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-8f2af316-c868-418d-951d-f93f6c273d30 req-488ccf09-03d3-4ffd-bce5-3a7442bb950f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028691 Jul 28 09:29:26.310395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 374/725] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:26.775897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:26.777173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:26.783439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:26.783929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:26.784707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:26.785146 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:26.864289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-aca20bf7-eef5-437d-95ec-22a19ff26b92 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.091951 Jul 28 09:29:26.865489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 352/726] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:26 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:27.075543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:27.076869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:27.083623 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.084299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.085535 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.086674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.265139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:27.273264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-186a9a57-bacd-4406-a4e2-dd070c774af2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1318 microversion: 2.1 time: 0.201721 Jul 28 09:29:27.273851 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 375/727] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:27 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:27.510061 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1381115717"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:27.510622 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:27.517881 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.518324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.519104 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.519530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.636982 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.network.security_group_api [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Adding security group 273126ff-0cda-46ea-b1e2-a3a68e803c1d to port 7bab243d-b602-40fd-a545-e20c1ce70bfa Jul 28 09:29:27.876317 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:27.877300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:27.882942 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.883368 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.884171 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.884600 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.946537 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9352f482-9b99-44c1-b569-a127e70f81e8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.074529 Jul 28 09:29:27.947344 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 376/728] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:27 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:27.970020 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7277b5bc-67da-496b-96d6-704110ec64ef tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/action" status: 202 len: 0 microversion: 2.1 time: 0.464068 Jul 28 09:29:27.974281 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 353/729] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:29:27 2021] POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:27.983910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:27.984709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:27.991346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.991854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:27.992647 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:27.993258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:28.131008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:28.139676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-405544e2-2447-49a6-a3a9-5a3a40ce31fc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1761 microversion: 2.1 time: 0.161215 Jul 28 09:29:28.140248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 377/730] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:27 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:28.291118 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:28.291869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:28.297713 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:28.298162 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:28.298929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:28.299360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:28.324080 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-ac1fba21-4e3e-4a9c-aa03-a6e4bcdaa283 req-2673972b-ec0e-47c8-8399-efdfc9d65d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:28.326469 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:28.326469 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:29:28.333671 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-ac1fba21-4e3e-4a9c-aa03-a6e4bcdaa283 req-2673972b-ec0e-47c8-8399-efdfc9d65d1d service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:28.334444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-ac1fba21-4e3e-4a9c-aa03-a6e4bcdaa283 req-2673972b-ec0e-47c8-8399-efdfc9d65d1d service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:28.346945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-ac1fba21-4e3e-4a9c-aa03-a6e4bcdaa283 req-2673972b-ec0e-47c8-8399-efdfc9d65d1d service nova] Creating event network-changed:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:29:28.352080 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-ac1fba21-4e3e-4a9c-aa03-a6e4bcdaa283 req-2673972b-ec0e-47c8-8399-efdfc9d65d1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031407 Jul 28 09:29:28.352746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 378/731] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:29:28.665158 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:28.673357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f30e94ab-9640-4da7-892e-f577785f6334 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1506 microversion: 2.1 time: 0.385959 Jul 28 09:29:28.673928 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 354/732] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:28 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:28.962432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:28.962432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:28.966913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:28.967588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:28.968527 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:28.968992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:29.037905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b3780976-a27e-45df-8881-ada9662a7908 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.083220 Jul 28 09:29:29.041047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 379/733] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:28 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:30.052583 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:30.054191 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:30.063792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:30.064511 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:30.065732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:30.066440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:30.132566 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-95785028-7678-4f84-86ce-37d59ada1948 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.086223 Jul 28 09:29:30.135757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 355/734] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:30 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:31.144386 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:31.145432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:31.152118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:31.152572 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:31.153897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:31.154335 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:31.229342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b90ee30e-767f-4bae-bca7-6c06a25b5ac5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.088797 Jul 28 09:29:31.229974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 380/735] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:31 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:32.240431 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:32.241649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:32.247856 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:32.248298 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:32.249062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:32.249489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:32.322383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4394ac32-8615-43e8-b29f-5007ec7e6b5f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.085808 Jul 28 09:29:32.323145 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 356/736] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:32 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:33.333606 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:33.334610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:33.341184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:33.341831 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:33.342609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:33.343045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:33.411525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-68b1bf92-448e-489c-9b97-8edaca247101 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.081833 Jul 28 09:29:33.412160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 381/737] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:33 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:34.423800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:34.424841 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:34.431277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:34.431754 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:34.432522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:34.432949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:34.500227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-06eb71ed-28cc-417e-86bc-762816ec5a7f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.080951 Jul 28 09:29:34.501089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 357/738] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:34 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:35.511838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:35.512789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:35.520226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:35.520677 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:35.521485 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:35.521926 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:35.586249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e4dad340-540a-4266-afe1-b1ce9090f212 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.078341 Jul 28 09:29:35.586877 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 382/739] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:35 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:36.598265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:36.599380 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:36.605996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:36.606467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:36.608011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:36.608346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:36.682276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7bb9ded8-3c1f-4089-ba27-fb5fa010982e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.088054 Jul 28 09:29:36.682914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 358/740] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:36 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:37.693731 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:37.694738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:37.701412 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:37.701862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:37.702628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:37.703056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:37.782238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-45a3bbdd-81f6-4a5c-a9f6-abf5c107c33a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.092335 Jul 28 09:29:37.782973 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 383/741] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:37 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:38.793065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:38.794037 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:38.801219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:38.801661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:38.802421 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:38.802860 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:38.864333 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e5f1c269-57dd-41ef-841b-81ead354775e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14 microversion: 2.20 time: 0.075246 Jul 28 09:29:38.864945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 359/742] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:38 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:39.875726 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:39.876736 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:39.883103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:39.883549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:39.884354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:39.884786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:39.948973 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9a220fd4-d113-4b06-9fb0-df9e9d5e7992 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 7865 microversion: 2.20 time: 0.077205 Jul 28 09:29:39.949609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 384/743] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:39 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 7865 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:29:40.961815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:40.962827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:40.969454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:40.969897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:40.970672 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:40.971104 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:41.035932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1d91b060-b134-4785-85ea-359c8ed640ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 14890 microversion: 2.20 time: 0.078213 Jul 28 09:29:41.036666 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 360/744] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:40 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 14890 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:29:42.050833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:42.052475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:42.061936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:42.062380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:42.063402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:42.064139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:42.141137 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-61cd85e9-d4c5-4a2c-94a1-8e88425825cd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 17861 microversion: 2.20 time: 0.096874 Jul 28 09:29:42.141764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 385/745] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:42 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 17861 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:43.152597 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:43.153622 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:43.160652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:43.161104 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:43.161946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:43.162375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:43.231552 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-978e6c77-1819-4fdb-9cc7-08af7a016994 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 17861 microversion: 2.20 time: 0.083498 Jul 28 09:29:43.232978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 361/746] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:43 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 17861 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:44.341649 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:44.342979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:44.348966 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:44.349408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:44.350158 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:44.350585 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:44.426848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7c902c77-f06e-4ff4-b596-27fe4ec0ca09 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 19342 microversion: 2.20 time: 0.186856 Jul 28 09:29:44.427446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 386/747] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:44 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 19342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:45.438876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:45.439908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:45.446573 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:45.447066 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:45.447902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:45.448330 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:45.533160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5061ea21-1cc0-4196-beea-21e5966cc68e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 21935 microversion: 2.20 time: 0.098387 Jul 28 09:29:45.533735 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 362/748] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:45 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 21935 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:46.545118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:46.546052 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:46.553107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:46.553553 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:46.554341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:46.554775 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:46.617189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3c0dc17d-6661-4cae-8c1e-93b2d0358a81 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 22981 microversion: 2.20 time: 0.076050 Jul 28 09:29:46.617808 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 387/749] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:46 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 22981 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:47.325457 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:47.326085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:47.333083 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:47.333530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:47.334297 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:47.334734 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:47.356528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lazy-loading 'flavor' on Instance uuid 032593b8-197f-4f27-a1af-b2388f64a7d3 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:29:47.424138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-19647b2d-4600-47e8-87de-605e3eed70e3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "POST /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3/action" status: 202 len: 0 microversion: 2.1 time: 0.102527 Jul 28 09:29:47.424762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 363/750] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:29:47 2021] POST /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:47.433180 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:47.433877 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:47.441959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:47.442514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:47.443399 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:47.444836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:47.613975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:47.621323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7ec3bc9e-e5e7-48bf-9558-95cddba803d9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.192100 Jul 28 09:29:47.621893 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 388/751] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:47 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:47.629021 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:47.630050 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:47.635930 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:47.636373 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:47.637135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:47.637561 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:47.709437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-35de26cd-5c87-4835-88be-fdc75897521e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 23804 microversion: 2.20 time: 0.085021 Jul 28 09:29:47.710069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 364/752] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:47 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 23804 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:48.070985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f13517b-d5ff-43ba-8ff1-263b1a7f9ee5", "device": "/dev/sdb"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:48.072640 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:48.079283 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:48.079960 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:48.080734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:48.081164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:48.316513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ea1e4c91-84e3-4d12-bfa7-4ab545d4973c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "POST /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249146 Jul 28 09:29:48.317118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 389/753] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:29:48 2021] POST /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:48.639549 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:48.641033 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:48.647340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:48.647826 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:48.648630 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:48.649067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:48.722961 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:48.724187 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:48.738899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:48.739694 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:48.740578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:48.741057 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:48.800732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:48.811052 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bb01c8a4-4356-4bd0-8e15-407e78afeaf9 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.175261 Jul 28 09:29:48.812666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fb97c64a-ebe4-4d5d-9d55-3247a32ae449 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 24616 microversion: 2.20 time: 0.093631 Jul 28 09:29:48.822454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 365/755] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:48 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:48.823729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 390/755] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:48 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 24616 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:29:49.830054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:49.830700 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:49.833933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:49.834932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:49.837005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:49.837471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:49.838226 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:49.838658 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:49.841300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:49.841751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:49.842520 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:49.843503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:49.914400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a47c7631-eb1a-4e8a-9e63-7fa78b6153c8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 25581 microversion: 2.20 time: 0.084212 Jul 28 09:29:49.918303 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 391/756] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:49 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 25581 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:29:49.962786 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:49.971729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-074ea6c1-773b-4342-830d-335b7d82a286 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.146379 Jul 28 09:29:49.972304 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 366/757] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:49 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:50.927749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:50.928758 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:50.935234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:50.935713 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:50.936533 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:50.937243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:50.989125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:50.989736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:50.995456 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:50.995930 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:50.996680 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:50.997108 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:51.005010 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bc7e7792-0a8b-497d-83da-94248def469f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 26567 microversion: 2.20 time: 0.081358 Jul 28 09:29:51.005880 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 392/758] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:50 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 26567 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:51.118565 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:51.125854 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-10f53e47-257c-44aa-9b68-d7cade20dc9c tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.140501 Jul 28 09:29:51.126405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 367/759] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:50 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:52.017328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:52.018352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:52.025592 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.025930 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.027633 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.028325 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.112730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5069572b-1394-42e3-b0db-f65d0ab66946 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 27311 microversion: 2.20 time: 0.099383 Jul 28 09:29:52.116515 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 393/760] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:52 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 27311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:52.145230 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:52.146392 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:52.153177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.154119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.155290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.155869 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.205314 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:52.206035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:52.212445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.212882 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.213675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.214056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.239433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:29:52.284606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:52.290621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-261b88b5-603b-4e64-99a4-16ee8396f0a5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.152333 Jul 28 09:29:52.291186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 368/761] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:52 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:52.321782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a99b5e3b-3004-42ad-8bd3-fe5baa36cddd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 204 len: 0 microversion: 2.1 time: 0.120837 Jul 28 09:29:52.322644 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 394/762] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:29:52 2021] DELETE /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:29:52.333005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:52.334067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:52.339840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.340294 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.341060 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:52.341494 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:52.467377 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:52.475117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5f8d24ca-db76-4679-b681-e7b961568c50 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1675 microversion: 2.1 time: 0.148117 Jul 28 09:29:52.475692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 369/763] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:52 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:53.126040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:53.127375 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:53.134649 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:53.135100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:53.136265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:53.136379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:53.209512 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2135790a-c74d-47dc-92d5-d21ba344bddf tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 27718 microversion: 2.20 time: 0.088565 Jul 28 09:29:53.210150 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 395/764] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:53 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 27718 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:53.308862 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:53.309483 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:53.316075 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:53.316525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:53.317294 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:53.317727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:53.436028 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:53.443440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fb0562c9-80c5-44aa-a329-8dd6187f502b tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.138420 Jul 28 09:29:53.444032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 370/765] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:53 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:53.492597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:53.493325 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:53.500306 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:53.500749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:53.501514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:53.501945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:53.619656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:53.627523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a1d1decf-edf5-4fdc-a7d3-89a36b041743 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1675 microversion: 2.1 time: 0.138924 Jul 28 09:29:53.628426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 396/766] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:53 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:54.220661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:54.221642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:54.227682 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:54.228131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:54.228890 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:54.229322 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:54.295047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b224a2fe-e5cb-416c-9a94-19617529d47d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 27906 microversion: 2.20 time: 0.078530 Jul 28 09:29:54.295731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 371/767] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:54 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 27906 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:54.460492 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:54.461142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:54.466970 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:54.467406 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:54.468311 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:54.468747 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:54.591466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:54.599308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e5689a4a-38c2-4edd-8ba0-2467a2b8bd2e tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.143018 Jul 28 09:29:54.599906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 397/768] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:54 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:54.645517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:54.646242 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:54.652868 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:54.653313 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:54.654065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:54.654495 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:54.778244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:54.785695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e22c445a-b91d-44fb-b4e4-6e228232028c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1675 microversion: 2.1 time: 0.144117 Jul 28 09:29:54.786263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 372/769] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:54 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:55.306298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:55.307377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:55.313347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.313871 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.314640 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.315069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.379818 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-dc651f8e-634a-4195-b925-f1e0cfca28fd tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28151 microversion: 2.20 time: 0.077090 Jul 28 09:29:55.380733 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 398/770] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:55 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28151 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:55.616352 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:55.616897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:55.623292 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.624214 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.625141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.625609 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.803751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:55.804655 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:55.816357 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.819560 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.823171 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.823716 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.854363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:55.862005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bab800ff-426b-4134-b518-dbac03887810 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.249449 Jul 28 09:29:55.862596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 373/771] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:55 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:55.958184 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-ffb99a49-48e6-4d77-a782-6c1ba5bb78bf req-083d30f5-336e-4619-89e7-997cc00f497b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93e643c-a780-41fb-9719-43b374afe806", "name": "network-vif-deleted", "tag": "07e5d078-45f6-402a-8b20-74f5720941fe"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:55.960285 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:29:55.960285 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:29:55.969775 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:55.978533 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8f7713a5-ce32-449f-aeb6-387b176f333a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1608 microversion: 2.1 time: 0.179086 Jul 28 09:29:55.979074 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-ffb99a49-48e6-4d77-a782-6c1ba5bb78bf req-083d30f5-336e-4619-89e7-997cc00f497b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:55.979641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-ffb99a49-48e6-4d77-a782-6c1ba5bb78bf req-083d30f5-336e-4619-89e7-997cc00f497b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:55.980693 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 399/772] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:55 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1608 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:56.004293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-ffb99a49-48e6-4d77-a782-6c1ba5bb78bf req-083d30f5-336e-4619-89e7-997cc00f497b service nova] Creating event network-vif-deleted:07e5d078-45f6-402a-8b20-74f5720941fe for instance a93e643c-a780-41fb-9719-43b374afe806 on hv-cinder-80266 Jul 28 09:29:56.009692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-ffb99a49-48e6-4d77-a782-6c1ba5bb78bf req-083d30f5-336e-4619-89e7-997cc00f497b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145886 Jul 28 09:29:56.010696 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 374/773] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:29:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:29:56.392641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:29:56.393554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:56.399203 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:56.399686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:56.400455 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:56.400883 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:56.880790 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:56.881610 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:56.887628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:56.888077 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:56.888832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:56.889263 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:57.015138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:57.022430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-35d270c6-08da-47bc-93d9-728e9a4e0ebe tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.145809 Jul 28 09:29:57.022989 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 375/774] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:56 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:57.027404 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:57.028024 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:57.033912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:57.034353 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:57.035108 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:57.035536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:57.065504 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:57.065943 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:57.066381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lazy-loading 'fault' on Instance uuid a93e643c-a780-41fb-9719-43b374afe806 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:29:57.111078 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:57.118228 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-55f5e30a-136d-46ce-aa09-e9c5edda26ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1328 microversion: 2.1 time: 0.094315 Jul 28 09:29:57.118806 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 376/775] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:57 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:58.040270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:58.040964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:58.047232 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:58.047702 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:58.048455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:58.048882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:58.167903 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:58.175096 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-67010801-9bfc-4381-a74e-1ce4d253df17 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.138502 Jul 28 09:29:58.175676 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 377/776] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:58 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:58.179795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:58.180398 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:58.186340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:58.187053 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:58.187983 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:58.188425 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:58.220334 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:58.220784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:58.221231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lazy-loading 'fault' on Instance uuid a93e643c-a780-41fb-9719-43b374afe806 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:29:58.259161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:58.266983 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7a8bb276-da0e-4d2a-85ed-eb44409224ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 200 len: 1328 microversion: 2.1 time: 0.090370 Jul 28 09:29:58.267548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 378/777] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:58 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:29:59.193764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:59.194430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:59.202705 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:59.202934 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c31956e1-d4c2-4cc2-b81c-95b5a0bf6179 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28196 microversion: 2.20 time: 2.814314 Jul 28 09:29:59.203356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:59.203874 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 400/778] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:29:56 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28196 bytes in 2817 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:29:59.207152 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:59.207152 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:59.284384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:59.285142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:29:59.291518 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:59.292001 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:59.292766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:29:59.293196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:29:59.307243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] HTTP exception thrown: Instance a93e643c-a780-41fb-9719-43b374afe806 could not be found. Jul 28 09:29:59.307866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Returning 404 to user: Instance a93e643c-a780-41fb-9719-43b374afe806 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:29:59.308701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-055190ea-06c3-47ba-b13a-3ef795c6b097 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 404 len: 111 microversion: 2.1 time: 0.028923 Jul 28 09:29:59.309425 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 401/779] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:59 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:29:59.317333 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a0f5b89d-42ff-464a-b771-98e79ad96113 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '.version_select at 0x7f16d03a3550>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:29:59.335177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:29:59.335652 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a0f5b89d-42ff-464a-b771-98e79ad96113 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701143215" status: 202 len: 0 microversion: 2.1 time: 0.021684 Jul 28 09:29:59.336425 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 402/780] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Jul 28 09:29:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1701143215 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:29:59.343569 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-329be1bb-10b2-40d9-b349-e11208108c5d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.154472 Jul 28 09:29:59.344175 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 379/781] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:29:59 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:29:59.983368 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f5736672-3b07-4069-a000-78c977b80bbd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: .version_select at 0x7f16d04ce0d0>, body: {"keypair": {"name": "tempest-keypair-1374875866"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:00.003762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-f5736672-3b07-4069-a000-78c977b80bbd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:30:00.007637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-f5736672-3b07-4069-a000-78c977b80bbd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for user c6defae8d5f64f56ac3c5f3d3abd9aff and project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:30:00.168404 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-f5736672-3b07-4069-a000-78c977b80bbd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:30:00.172360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-f5736672-3b07-4069-a000-78c977b80bbd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for user c6defae8d5f64f56ac3c5f3d3abd9aff and project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'key_pairs'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:30:00.185873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f5736672-3b07-4069-a000-78c977b80bbd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.206314 Jul 28 09:30:00.192067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 403/782] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jul 28 09:29:59 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:00.214436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:00.215755 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:00.222743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.223289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.224206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.224731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.299003 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-38792183-87a1-48f0-9b07-1ec28ca25925 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28196 microversion: 2.20 time: 0.088306 Jul 28 09:30:00.299915 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 380/783] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:00 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28196 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:00.321580 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:00.322538 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:00.330361 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.330815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.331641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.332079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.368071 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:00.375980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:00.386501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.388600 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.390163 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.390792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.413926 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a705f59a-c121-43ed-8286-d5490b93dc93 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/action" status: 202 len: 0 microversion: 2.1 time: 0.096451 Jul 28 09:30:00.414639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 404/784] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:00 2021] POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:00.424149 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:00.424846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:00.430855 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.431290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.432238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:00.432616 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:00.576098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:00.587815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-92b8bb39-75e7-49c4-9f88-03e953578acb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.230641 Jul 28 09:30:00.589199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 381/785] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:00 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:00.654348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:00.663053 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3d1153e6-452e-49b1-8cd2-5e9244b324a7 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1753 microversion: 2.1 time: 0.244224 Jul 28 09:30:00.663645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 405/786] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:00 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:01.312364 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:01.313343 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:01.319409 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:01.319895 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:01.320674 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:01.321112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:01.607861 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:01.609146 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:01.615498 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:01.616046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:01.616995 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:01.617493 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:02.030657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:02.037909 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ae7d5a14-91d3-47e5-bc1f-93769fb5feaa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.435601 Jul 28 09:30:02.038464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 406/787] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:01 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:02.043039 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-70076844", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39e9cde6-0d01-4242-a6ed-06857cf13960"}], "security_groups": [{"name": "tempest-securitygroup--2052876746"}], "key_name": "tempest-keypair-1374875866", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:02.143662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] validate_networks() for [('39e9cde6-0d01-4242-a6ed-06857cf13960', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:30:02.539409 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:30:02.539866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:30:02.540366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:30:02.540770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:30:02.541177 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:30:02.550676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:02.551119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:02.551959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:02.552390 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:02.568412 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:30:02.572256 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Getting quotas for user c6defae8d5f64f56ac3c5f3d3abd9aff and project 9a1f63fb540e42f18f0ec634cc138c04. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:30:02.583899 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:30:02.586451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:30:02.638104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e3f0d2dd-5c8b-468e-b815-26139ae88f3a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598578 Jul 28 09:30:02.639101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 407/788] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:30:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:30:02.644771 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:02.645151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:02.651416 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:02.652264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:02.653050 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:02.653486 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:02.784234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:02.792522 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2f27feac-9862-40df-ac3f-d0840049b76c tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1753 microversion: 2.1 time: 0.152014 Jul 28 09:30:02.793022 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 408/789] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:02 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:02.797778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a3935c81-a78d-441a-b24b-f3ddcafd3532 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:02.798381 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a3935c81-a78d-441a-b24b-f3ddcafd3532 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:02.855418 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a3935c81-a78d-441a-b24b-f3ddcafd3532 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:02.864517 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a3935c81-a78d-441a-b24b-f3ddcafd3532 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1236 microversion: 2.1 time: 0.070424 Jul 28 09:30:02.865091 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 409/790] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:02 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:03.055482 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:03.056395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:03.068211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:03.068667 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:03.069492 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:03.069966 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:03.208149 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:03.215826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b34c4f2a-c2c9-409f-bce7-38d39a9a9c51 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.164928 Jul 28 09:30:03.216382 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 410/791] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:03 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:03.519221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e9629db0-a97e-48db-9024-95a7c3918c35 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28487 microversion: 2.20 time: 2.211276 Jul 28 09:30:03.520075 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 382/792] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:01 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28487 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:03.810007 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:03.810644 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:03.816509 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:03.816950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:03.817711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:03.818141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:03.881980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:03.882711 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:03.889248 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:03.889914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:03.890692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:03.891129 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:03.962414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:03.970012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fdd158ef-af4a-4d83-bb72-e8b42918cc6d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1288 microversion: 2.1 time: 0.092119 Jul 28 09:30:03.970587 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 383/793] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:03 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:03.994359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:04.003041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-96ed5c69-7066-4a79-874c-fc9f3a8b2524 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1753 microversion: 2.1 time: 0.196778 Jul 28 09:30:04.003628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 411/794] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:03 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:04.233980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:04.234946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:04.242295 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:04.242716 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:04.243487 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:04.243944 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:04.520506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:04.528982 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7e621ce9-fa91-4b6b-86b8-6d430da94bfb tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.299415 Jul 28 09:30:04.529750 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 384/795] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:04 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:04.530892 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:04.532197 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:04.538320 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:04.538766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:04.539540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:04.540004 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:04.605673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4ffe3807-15fe-4f7f-8b8d-2f9b459dca30 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28487 microversion: 2.20 time: 0.078768 Jul 28 09:30:04.606755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 412/796] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:04 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28487 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:04.986591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:04.987332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:04.993766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:04.994310 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:04.995162 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:04.995621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.019650 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:05.020525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:05.027411 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:05.027957 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.028979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:05.029545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.060736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:05.069157 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d06777fc-98a7-4ff4-896c-a6566b0babf2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1294 microversion: 2.1 time: 0.086730 Jul 28 09:30:05.069731 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 385/797] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:04 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:05.252935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:05.261665 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-843561ec-2968-46b6-9e6a-9db1e2630719 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.246009 Jul 28 09:30:05.262255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 413/798] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:05 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:05.546485 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:05.547024 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:05.552918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:05.553471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.554238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:05.554670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.617846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:05.619188 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:05.624984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:05.625440 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.626216 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:05.626656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:05.675541 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:05.682845 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-cd7976d4-1735-4c19-bf9f-45be7840cf6d tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.140337 Jul 28 09:30:05.683430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 386/799] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:05 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:06.085712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:06.086348 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:06.092077 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:06.092519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:06.093273 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:06.093703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:06.211642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:06.219137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f1492178-eb7b-430e-b0ff-1fa062b24bcf tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.137025 Jul 28 09:30:06.219739 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 387/800] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:06 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:06.279116 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:06.279950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:06.285748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:06.286190 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:06.286948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:06.287381 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:06.412627 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:06.420853 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d26f7cdb-af05-4a64-bca7-b01e1675992e tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.144948 Jul 28 09:30:06.421419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 388/801] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:06 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:06.699907 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:06.700546 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:06.707062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:06.707514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:06.708306 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:06.708743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:06.831356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:06.838631 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b21f7a0d-a3a6-4bec-b833-0c74a44e4fc4 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.142532 Jul 28 09:30:06.839197 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 389/802] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:06 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:07.235484 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:07.236131 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:07.242455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:07.242909 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:07.243755 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:07.244133 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:07.363774 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:07.370958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a3b5a17e-4705-4673-a58e-2c2cd624edea tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.139204 Jul 28 09:30:07.371513 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 390/803] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:07 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:07.437370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:07.437964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:07.443488 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:07.443957 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:07.444707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:07.445133 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:07.567719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:07.575389 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0967136e-3e1f-4d61-b2e2-cf9660312262 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.141854 Jul 28 09:30:07.575977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 391/804] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:07 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:07.798565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e89ab85f-c0d9-4a28-a5fa-774d7da16dd1 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28655 microversion: 2.20 time: 2.184195 Jul 28 09:30:07.799217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 414/805] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:05 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28655 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:07.855929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:07.857044 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:07.862985 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:07.863505 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:07.864320 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:07.864747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.188170 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:08.195543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-960fef28-1a31-4808-a89e-43d7666c36bc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.343328 Jul 28 09:30:08.196157 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 392/806] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:07 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:08.390175 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:08.391025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:08.398253 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.398702 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.399519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.400077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.592073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:08.593004 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:08.599241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.599669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.600437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.600868 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.694280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:08.702862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-eaba1dd2-5311-445f-ab96-221d2c13ab07 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.318400 Jul 28 09:30:08.714593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 415/807] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:08 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:08.714593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-49861c13-982f-4095-bb2b-354aebdc25a3 req-ecf73700-b560-42cb-94f4-72a3c8eef25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fc17a0-50df-4194-8803-370abbf93106", "tag": "9cebf7da-ff2a-47b7-8013-16bf419f7ead"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:08.715915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:08.715915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:30:08.723335 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-49861c13-982f-4095-bb2b-354aebdc25a3 req-ecf73700-b560-42cb-94f4-72a3c8eef25a service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.723838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-49861c13-982f-4095-bb2b-354aebdc25a3 req-ecf73700-b560-42cb-94f4-72a3c8eef25a service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.736216 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-49861c13-982f-4095-bb2b-354aebdc25a3 req-ecf73700-b560-42cb-94f4-72a3c8eef25a service nova] Creating event network-changed:9cebf7da-ff2a-47b7-8013-16bf419f7ead for instance f8fc17a0-50df-4194-8803-370abbf93106 on hv-cinder-80266 Jul 28 09:30:08.741261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-49861c13-982f-4095-bb2b-354aebdc25a3 req-ecf73700-b560-42cb-94f4-72a3c8eef25a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033601 Jul 28 09:30:08.742044 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 416/808] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:08.811486 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:08.814274 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:08.827179 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.836721 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.838159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:08.838833 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:08.914720 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:08.916755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-760a5e9f-2571-4f75-a992-6e50de08b58f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28655 microversion: 2.20 time: 0.110109 Jul 28 09:30:08.917451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 417/809] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:08 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28655 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:08.925764 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-df9cf146-d6cc-40f4-a584-c65e6a555366 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.337679 Jul 28 09:30:08.926517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 393/810] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:08 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:09.214120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:09.214825 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:09.221450 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.221905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.222694 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.223135 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.412475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:09.420389 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-55410a40-b61a-4fad-886e-8abf769b7715 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.209770 Jul 28 09:30:09.420956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 418/811] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:09 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:09.722577 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:09.723193 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:09.729288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.729681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.730445 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.730880 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.849319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:09.856941 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-30670557-a5a8-43d0-a1a8-25403b86ead8 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.137931 Jul 28 09:30:09.858440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 394/812] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:09 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:09.929630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:09.930709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:09.937364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.937766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.938634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.939065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.943230 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:09.943910 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:09.949761 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.950213 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:09.950983 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:09.952729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.009785 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7b9022e3-fe36-403b-b6d5-43091444262b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28655 microversion: 2.20 time: 0.083809 Jul 28 09:30:10.010939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 419/813] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:09 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28655 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:10.099603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:10.108217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2a036f2d-a91a-483f-bb99-aef9b7157b20 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.168208 Jul 28 09:30:10.108784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 395/814] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:09 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:10.438119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:10.438852 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:10.445348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.445792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.446562 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.446997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.566843 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:10.574156 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7dac8f5b-c8dd-4253-a6b0-3ff2763727aa tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1571 microversion: 2.1 time: 0.140461 Jul 28 09:30:10.574733 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 420/815] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:10 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1571 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:10.591189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:10.592347 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:10.598665 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.599137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.599992 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.600450 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.674017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a7d82db7-b845-4626-b36d-a80128664747 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "POST /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3/action" status: 202 len: 0 microversion: 2.1 time: 0.086553 Jul 28 09:30:10.674616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 396/816] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:10 2021] POST /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:10.682447 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:10.683063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:10.689149 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.689684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.690457 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.690901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.853829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:10.861932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-48d637bd-0f5a-4f9a-8c71-b504721a1462 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1579 microversion: 2.1 time: 0.183074 Jul 28 09:30:10.862502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 421/817] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:10 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:10.875533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:10.876176 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:10.883608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.883952 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:10.884873 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:10.885262 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:11.013450 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:11.020854 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6050d56d-14a8-43c8-969a-fe67c93cf54b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.150540 Jul 28 09:30:11.021406 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 397/818] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:10 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:11.023110 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:11.024176 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:11.031524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:11.032021 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:11.032960 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:11.033431 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:11.114897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-be817d23-620b-456e-b383-0200594e8036 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28655 microversion: 2.20 time: 0.096703 Jul 28 09:30:11.115542 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 422/819] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:11 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:11.125615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:11.126262 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:11.132639 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:11.133087 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:11.133858 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:11.134290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:11.278922 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:11.286737 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7b05a8ff-f24e-4069-8b4d-6e65209467ca tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.165287 Jul 28 09:30:11.287309 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 398/820] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:11 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:11.880092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:11.880920 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:11.890281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:11.891000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:11.892186 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:11.892930 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.041157 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:12.042466 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:12.051382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.052005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.053130 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.054556 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.057539 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:12.070979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-01836401-3c75-4fb0-b89b-3521916fb931 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1521 microversion: 2.1 time: 0.195439 Jul 28 09:30:12.082662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 423/821] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:11 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:12.129898 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:12.131452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:12.139399 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.139922 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.140800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.141285 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.214451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cc768fb3-ad72-42d5-b97b-8086fd083124 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 28983 microversion: 2.20 time: 0.091047 Jul 28 09:30:12.215113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 424/822] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:12 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 28983 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:12.220881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:12.221464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:12.228604 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.229322 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.230284 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.230775 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.330752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'services' on Instance uuid 46e2d206-3f5b-4f95-aa68-f85c12f23d1c {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:30:12.416142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-62f9f0dd-3bf1-456a-9362-0b3f7ec973b3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c/os-volume_attachments/2f13517b-d5ff-43ba-8ff1-263b1a7f9ee5" status: 202 len: 0 microversion: 2.1 time: 0.199241 Jul 28 09:30:12.416767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 425/823] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:30:12 2021] DELETE /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c/os-volume_attachments/2f13517b-d5ff-43ba-8ff1-263b1a7f9ee5 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:12.424762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:12.425748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:12.434856 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.436088 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.437054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:12.438968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:12.598051 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:12.605367 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2579981d-7174-4d30-9e4c-4835831dbe8e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.571097 Jul 28 09:30:12.605933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 399/824] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:12 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:12.703097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:12.710945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6b1ef50b-4cc3-46c6-872c-c123cd008bfc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.292525 Jul 28 09:30:12.711635 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 426/825] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:12 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:13.090047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:13.090662 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:13.097065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.097473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.098249 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.098687 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.224418 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:13.226439 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:13.227377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:13.231838 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e61c0668-6cb4-4fff-8c46-192d42a38fc5 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.145549 Jul 28 09:30:13.234248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.234701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.235483 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.235963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.241864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 400/826] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:13 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:13.307056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0bfc47cc-57a6-4437-8c21-92cf74957029 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 30326 microversion: 2.20 time: 0.084207 Jul 28 09:30:13.307744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 427/827] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:13 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 30326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:13.575496 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:13.577021 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:13.583068 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.583517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.584463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.584980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.609472 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:30:13.625030 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:13.625839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:13.632250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.632911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.633700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.634355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.696046 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-634cb623-476d-4258-a0b8-24d5b1c522d8 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 204 len: 0 microversion: 2.1 time: 0.123704 Jul 28 09:30:13.697195 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 401/828] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:30:13 2021] DELETE /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:30:13.706294 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:13.707121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:13.713350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.713874 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.714710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.715307 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.775797 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:13.784267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4cdc66ee-199e-46af-821c-970c2b5e1099 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.163982 Jul 28 09:30:13.791881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 428/829] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:13 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:13.791881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:13.791881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:13.796204 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.797564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.798585 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:13.799241 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:13.901921 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:13.912749 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-851819ab-f241-47eb-a17b-b79ea943991c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1512 microversion: 2.1 time: 0.209952 Jul 28 09:30:13.914082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 402/830] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:13 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:13.974472 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:13.983783 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ecd262dd-342e-4f62-bee3-d6a1eb5656d5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.197302 Jul 28 09:30:13.993211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 429/831] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:13 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:14.049707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-257fe450-e72c-4776-8e7d-f61660bb6a52 req-52f5a18e-e632-47cd-af6a-caae57ecde72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fc17a0-50df-4194-8803-370abbf93106", "name": "network-vif-plugged", "status": "completed", "tag": "9cebf7da-ff2a-47b7-8013-16bf419f7ead"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:14.051278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:14.051278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:30:14.058343 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-257fe450-e72c-4776-8e7d-f61660bb6a52 req-52f5a18e-e632-47cd-af6a-caae57ecde72 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.058787 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-257fe450-e72c-4776-8e7d-f61660bb6a52 req-52f5a18e-e632-47cd-af6a-caae57ecde72 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.070423 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-257fe450-e72c-4776-8e7d-f61660bb6a52 req-52f5a18e-e632-47cd-af6a-caae57ecde72 service nova] Creating event network-vif-plugged:9cebf7da-ff2a-47b7-8013-16bf419f7ead for instance f8fc17a0-50df-4194-8803-370abbf93106 on hv-cinder-80266 Jul 28 09:30:14.075542 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-257fe450-e72c-4776-8e7d-f61660bb6a52 req-52f5a18e-e632-47cd-af6a-caae57ecde72 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091616 Jul 28 09:30:14.076290 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 403/832] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:30:14.249712 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:14.250406 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:14.256428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.261244 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.262054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.262503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.318811 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:14.320538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:14.328481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.329143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.330140 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.330739 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.414212 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:14.421710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0a267716-aba9-44cd-85b4-a92cac4f7cf3 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.176407 Jul 28 09:30:14.422276 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 430/833] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:14 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:14.457980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-12af4545-20c9-4dba-8464-73f64643e510 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 31803 microversion: 2.20 time: 0.143112 Jul 28 09:30:14.458618 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 404/834] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:14 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 31803 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:14.800905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:14.801523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:14.807935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.808415 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.809190 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.809635 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.930621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:14.931322 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:14.932569 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:14.938919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.939398 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.940201 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:14.940402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c456a0ee-c75b-4245-8dd2-f4612b4a4f09 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1362 microversion: 2.1 time: 0.143288 Jul 28 09:30:14.940637 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:14.940971 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 431/835] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:14 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:15.001090 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:15.002141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:15.008394 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.008862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.009629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.010052 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.089908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:15.097182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-955b229b-822b-48f6-bcf5-9fdd94448733 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1512 microversion: 2.1 time: 0.170645 Jul 28 09:30:15.097746 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 405/836] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:14 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:15.151101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:15.159493 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-062d9913-75dc-454c-85fd-a85109ff0d80 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.162861 Jul 28 09:30:15.160099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 432/837] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:14 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:15.438690 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:15.439206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:15.444913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.445383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.446145 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.446597 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.469057 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:15.470058 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:15.475882 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.476334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.477109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.477572 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.567178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:15.568639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-892d522c-50a0-4402-8ecf-90c26fb731d4 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 32671 microversion: 2.20 time: 0.103045 Jul 28 09:30:15.569366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 433/838] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:15 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 32671 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:15.574729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0f38edf5-dfc9-421e-b4a4-919bab34c3f1 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.140424 Jul 28 09:30:15.575280 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 406/839] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:15 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:15.958447 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:15.959488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:15.966425 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.967248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:15.968169 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:15.968697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.092669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-438504a0-228d-4fa1-94c6-68ba9c5513ea req-62056902-e70f-44a9-a468-4d26e153ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "name": "network-vif-unplugged", "status": "completed", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:16.094410 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:16.094410 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:30:16.101967 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-438504a0-228d-4fa1-94c6-68ba9c5513ea req-62056902-e70f-44a9-a468-4d26e153ea6f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.102434 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-438504a0-228d-4fa1-94c6-68ba9c5513ea req-62056902-e70f-44a9-a468-4d26e153ea6f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.115640 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-438504a0-228d-4fa1-94c6-68ba9c5513ea req-62056902-e70f-44a9-a468-4d26e153ea6f service nova] Creating event network-vif-unplugged:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:30:16.120852 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-438504a0-228d-4fa1-94c6-68ba9c5513ea req-62056902-e70f-44a9-a468-4d26e153ea6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032449 Jul 28 09:30:16.122147 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 407/840] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:30:16.129104 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:16.129821 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:16.136804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.137446 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.138745 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.139216 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.211666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:16.219164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7cab4525-8a0d-41ca-a02b-93c1ef60ce77 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1549 microversion: 2.1 time: 0.264905 Jul 28 09:30:16.227695 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:16.230222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 434/841] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:15 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1549 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:16.235510 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:16.236142 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:16.238342 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-17c52068-75c5-4a9d-8ade-ba18c0e0f8e0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 200 len: 1470 microversion: 2.1 time: 0.114516 Jul 28 09:30:16.239497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 408/842] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:16 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 1470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:16.246003 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-68c2efac-329e-4821-bdf3-b9361d26dc27 req-6580a506-1de9-41d8-a117-0dbd13379376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46e2d206-3f5b-4f95-aa68-f85c12f23d1c", "name": "network-vif-deleted", "tag": "6f7ebd84-ae8e-4b9f-95d6-e4a3e913639b"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:16.247493 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:16.247493 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:30:16.252119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.252561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.253335 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.253763 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.257394 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-68c2efac-329e-4821-bdf3-b9361d26dc27 req-6580a506-1de9-41d8-a117-0dbd13379376 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.258146 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-68c2efac-329e-4821-bdf3-b9361d26dc27 req-6580a506-1de9-41d8-a117-0dbd13379376 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.272143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-68c2efac-329e-4821-bdf3-b9361d26dc27 req-6580a506-1de9-41d8-a117-0dbd13379376 service nova] Creating event network-vif-deleted:6f7ebd84-ae8e-4b9f-95d6-e4a3e913639b for instance 46e2d206-3f5b-4f95-aa68-f85c12f23d1c on hv-cinder-80266 Jul 28 09:30:16.277641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-68c2efac-329e-4821-bdf3-b9361d26dc27 req-6580a506-1de9-41d8-a117-0dbd13379376 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036400 Jul 28 09:30:16.281647 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 409/843] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:16.287266 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:16.287876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:16.294117 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.295090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.296355 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.296963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.407636 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-07626ea2-8941-4fd0-8516-e4a80c7a7fc2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124682 Jul 28 09:30:16.413795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 410/844] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Jul 28 09:30:16 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:16.427565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:16.435641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-49b88fd3-78ff-4b5b-acde-f7ea0efb6461 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.204086 Jul 28 09:30:16.436221 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 435/845] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:16 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:16.580994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:16.581950 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:16.588854 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.589326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.594193 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:16.594915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:16.600272 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.604624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.607310 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.607923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.608910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:16.609522 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:16.677057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7d99b7c4-8267-4189-bce8-d3c824ce0e15 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 33640 microversion: 2.20 time: 0.100298 Jul 28 09:30:16.682316 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 411/846] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:16 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 33640 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:16.756291 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:16.767299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9e36926e-0fec-4eb5-97e8-3a6d270e3210 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.178874 Jul 28 09:30:16.767927 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 436/847] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:16 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:17.256266 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:17.257071 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 46e2d206-3f5b-4f95-aa68-f85c12f23d1c] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:17.263588 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.264057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.264824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.265260 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.279871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] HTTP exception thrown: Instance 46e2d206-3f5b-4f95-aa68-f85c12f23d1c could not be found. Jul 28 09:30:17.280469 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Returning 404 to user: Instance 46e2d206-3f5b-4f95-aa68-f85c12f23d1c could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:30:17.281304 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-855d77ad-644e-4d4f-9528-f25b1bfc29e2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c" status: 404 len: 111 microversion: 2.1 time: 0.029144 Jul 28 09:30:17.281858 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 412/848] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:17 2021] GET /compute/v2.1/servers/46e2d206-3f5b-4f95-aa68-f85c12f23d1c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:30:17.340849 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:17.342387 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:17.354816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.355296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.356173 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.356562 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.414255 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-4573ea6e-e5a8-4bb1-bf16-156b584a9e95 req-9afeb9fc-07e9-4573-88a8-3b0cf4718b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fc17a0-50df-4194-8803-370abbf93106", "tag": "9cebf7da-ff2a-47b7-8013-16bf419f7ead"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:17.416135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:17.416135 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:30:17.424063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a089820e-b736-49bc-82c1-89fb43442d1d tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 0.086559 Jul 28 09:30:17.426370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-4573ea6e-e5a8-4bb1-bf16-156b584a9e95 req-9afeb9fc-07e9-4573-88a8-3b0cf4718b09 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.427085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-4573ea6e-e5a8-4bb1-bf16-156b584a9e95 req-9afeb9fc-07e9-4573-88a8-3b0cf4718b09 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.427685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 437/849] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:17 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:30:17.442580 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-4573ea6e-e5a8-4bb1-bf16-156b584a9e95 req-9afeb9fc-07e9-4573-88a8-3b0cf4718b09 service nova] Creating event network-changed:9cebf7da-ff2a-47b7-8013-16bf419f7ead for instance f8fc17a0-50df-4194-8803-370abbf93106 on hv-cinder-80266 Jul 28 09:30:17.445532 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-4573ea6e-e5a8-4bb1-bf16-156b584a9e95 req-9afeb9fc-07e9-4573-88a8-3b0cf4718b09 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100599 Jul 28 09:30:17.450749 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 413/850] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:17.456109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:17.456814 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:17.472884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.473662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.475163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.475782 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.683987 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:17.690669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:17.692266 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:17.695327 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8312bb89-e34c-42e8-895d-2721169c3e07 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.245696 Jul 28 09:30:17.698685 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.699331 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.700314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.701603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.701799 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 438/851] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:17 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:17.785441 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:17.786055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:17.791937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.792385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.793155 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:17.793583 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:17.915388 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:17.923201 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fdda13a4-5421-4932-8bcc-58657fe530df tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.141528 Jul 28 09:30:17.923795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 439/852] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:17 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:18.435891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:18.436785 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:18.442672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:18.443115 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:18.443911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:18.444339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:20.503108 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3392f43a-8df6-47cf-ac38-213a4ea7d53f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 38123 microversion: 2.20 time: 2.816456 Jul 28 09:30:20.507245 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 414/853] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:17 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 38123 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:20.509247 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:20.509934 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:20.516378 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:20.516828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:20.517589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:20.518137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:20.521939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b57b6362-50ca-4811-a082-89d5388f7ee9 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 2.090182 Jul 28 09:30:20.523181 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 440/854] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:18 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:30:20.528552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:20.530719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:20.537511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:20.538306 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:20.539853 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:20.540298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:20.801423 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:20.809132 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bcd72691-e883-49f7-abd3-4644db58c692 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1758 microversion: 2.1 time: 0.303503 Jul 28 09:30:20.809273 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:20.810029 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 415/855] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:20 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1758 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:20.817273 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8764feac-a0bd-4206-add4-d15f74a1a16a tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.292693 Jul 28 09:30:20.817845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 441/856] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:20 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:21.515051 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:21.515997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:21.522184 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.522625 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.523451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.523939 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.533226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:21.534140 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:21.540802 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.541244 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.542000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.542426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.616391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6adfda9e-4f9a-4fab-925e-5a0d4d6ba9e6 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 0.086541 Jul 28 09:30:21.617030 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 442/857] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:21 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 09:30:21.620723 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a3735852-0e03-43d0-993a-3b8429b9bd86 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 38193 microversion: 2.20 time: 0.109938 Jul 28 09:30:21.621589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 416/858] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:21 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 38193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:21.826955 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:21.827702 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:21.834274 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.834728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.834853 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:21.835468 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:21.835662 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.835956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.842065 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.842517 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:21.843288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:21.843766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:22.014913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:22.021668 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:22.022589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-434ab958-f33d-4c70-9cd4-aa1e9bb8c637 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1577 microversion: 2.1 time: 0.192127 Jul 28 09:30:22.023159 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 417/859] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:21 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:22.029615 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4c5e2789-ad33-45c6-bcba-963b0f2e1b7a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1761 microversion: 2.1 time: 0.207454 Jul 28 09:30:22.030157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 443/860] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:21 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1761 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:22.627510 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:22.628597 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:22.632792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:22.633738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:22.634467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:22.634915 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:22.635778 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:22.636262 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:22.639545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:22.640088 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:22.640928 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:22.641369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:22.697206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f7819a1c-6dcf-441f-96fb-b5f1cbffa04b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 0.073106 Jul 28 09:30:22.697860 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 418/861] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:22 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:30:22.708018 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f4a544a8-0f87-48ab-b963-f429ff701934 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 38193 microversion: 2.20 time: 0.078679 Jul 28 09:30:22.708653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 444/862] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:22 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 38193 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:23.040032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:23.040721 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:23.047972 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:23.048413 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:23.049166 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:23.049591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:23.168240 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:23.176082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-049571a8-d053-43c4-861a-0551ea9915cd tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1564 microversion: 2.1 time: 0.140002 Jul 28 09:30:23.176633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 419/863] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:23 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1564 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:23.708445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:23.709371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:23.715839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:23.716410 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:23.717263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:23.717701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:23.720193 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:23.721115 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:23.726727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:23.727184 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:23.727948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:23.728375 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:25.965119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1e69261e-dc40-4816-ae9d-e8f804644c88 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 2.260676 Jul 28 09:30:25.965776 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 445/864] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:23 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:30:25.971902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f0b14d28-7f07-49be-81b7-3f0ff44495db tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 200 len: 38332 microversion: 2.20 time: 2.255723 Jul 28 09:30:25.972536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 420/865] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:23 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 38332 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:30:25.982597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:25.983169 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:25.989786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:25.990227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:25.991019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:25.991449 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:26.016564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6538600c-3b5c-49ec-bd8b-cff10b166c71 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/ips" status: 200 len: 151 microversion: 2.20 time: 0.037921 Jul 28 09:30:26.017126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 446/866] 10.222.0.23 () {60 vars in 1289 bytes} [Wed Jul 28 09:30:25 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:26.976981 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:26.977991 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:26.985320 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:26.985768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:26.986531 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:26.986970 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:27.052669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8a0ec05c-9221-4c75-869b-85964d32527a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 0.079553 Jul 28 09:30:27.053514 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 421/867] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:26 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:30:27.126507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-987792854", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452", "networks": [{"uuid": "8a24e155-c32e-4f22-a846-e3c555ee716a"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:27.182248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] validate_networks() for [('8a24e155-c32e-4f22-a846-e3c555ee716a', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:30:27.527423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:30:27.527916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:30:27.528579 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:30:27.529053 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:30:27.529502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:30:27.537947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:27.538385 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:27.539172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:27.539624 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:27.555752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Getting quotas for project 3fc892898a594e59889bda5edf6fe6fa. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:30:27.560397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Getting quotas for user d0395bff7c5848619b07ca4faf704ae4 and project 3fc892898a594e59889bda5edf6fe6fa. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:30:27.570716 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:30:27.573166 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:30:27.617796 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b4c0711a-eeae-4fb9-b68b-cd077ca5335f tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495431 Jul 28 09:30:27.618433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 447/868] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:30:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:30:27.629466 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-cc873000-be13-4a52-9c52-0bc7b15c6d35 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:27.630269 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-cc873000-be13-4a52-9c52-0bc7b15c6d35 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:27.683019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-cc873000-be13-4a52-9c52-0bc7b15c6d35 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:27.690275 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-cc873000-be13-4a52-9c52-0bc7b15c6d35 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1218 microversion: 2.1 time: 0.064933 Jul 28 09:30:27.690840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 422/869] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:27 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:28.064157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:28.065192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:28.071259 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.071750 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.072533 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.072974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.077897 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:28.078432 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:28.084341 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.084782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.085564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.085967 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.110984 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lazy-loading 'flavor' on Instance uuid 5a96654e-95dd-48bb-adf3-91e5eed7b520 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:30:28.134630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0d2097e0-a2ad-4f96-9f37-34e165102aca tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 14 microversion: 2.1 time: 0.074699 Jul 28 09:30:28.135396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 448/870] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:28 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:30:28.381663 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6e3c139e-d093-4c6e-b62c-d425f2e105c3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 202 len: 0 microversion: 2.20 time: 0.307463 Jul 28 09:30:28.382394 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 423/871] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:30:28 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:30:28.390558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:28.391269 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:28.397692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.398143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.398911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.399342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.526997 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:28.538689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:28.540213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:28.541358 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-84eb8adb-3f55-48c0-aa96-a3c86537107a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.154808 Jul 28 09:30:28.542143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 449/872] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:28 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:30:28.708207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:28.709314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:28.716275 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.716914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.717699 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.718134 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.758408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-c537b448-74b0-4b6a-9961-d3b7c675e033 req-34fbc6aa-a6bd-48ad-990c-1cb3b234f5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "name": "network-vif-plugged", "status": "completed", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:28.761302 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:28.761302 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:30:28.772565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c537b448-74b0-4b6a-9961-d3b7c675e033 req-34fbc6aa-a6bd-48ad-990c-1cb3b234f5ba service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:28.773011 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c537b448-74b0-4b6a-9961-d3b7c675e033 req-34fbc6aa-a6bd-48ad-990c-1cb3b234f5ba service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:28.794434 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-c537b448-74b0-4b6a-9961-d3b7c675e033 req-34fbc6aa-a6bd-48ad-990c-1cb3b234f5ba service nova] Creating event network-vif-plugged:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:30:28.798746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-c537b448-74b0-4b6a-9961-d3b7c675e033 req-34fbc6aa-a6bd-48ad-990c-1cb3b234f5ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044527 Jul 28 09:30:28.799315 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 450/873] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:30:28.814218 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:28.821680 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6f94f133-7791-438a-b4a8-2588fd3e8da0 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1276 microversion: 2.1 time: 0.117873 Jul 28 09:30:28.822254 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 424/874] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:28 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:29.145978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:29.147062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:29.153625 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:29.154213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:29.155069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:29.155508 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:29.218110 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c37b15bf-cf73-416d-9b66-3251ad83c048 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 7357 microversion: 2.1 time: 0.075982 Jul 28 09:30:29.221577 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 451/875] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:29 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 7357 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:29.561454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:29.562122 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:29.568409 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:29.569831 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:29.570653 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:29.571122 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:29.758574 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:29.767148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:29.768679 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:29.770124 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4be0b471-3349-4b78-9447-8f4ed6bcc309 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.214585 Jul 28 09:30:29.771147 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 425/876] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:29 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:29.839732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:29.840746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:29.848395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:29.848825 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:29.849779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:29.850205 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:30.229617 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:30.231166 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:30.242460 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:30.242951 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:30.244067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:30.244279 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:30.308648 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-378921ac-7a60-464e-b384-c61ace23dae3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 15025 microversion: 2.1 time: 0.082654 Jul 28 09:30:30.310505 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 426/877] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:30 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 15025 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:30.311334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:30.319359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a3ae244c-26f9-497c-bfee-ff9187c5494c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.483626 Jul 28 09:30:30.320104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 452/878] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:29 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:30.367282 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-92cf258e-a0f6-4a4f-a6ef-a8d88f33bbee req-16738889-34e8-49b3-8bac-508f7b2c40a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c381b9f-420f-4e11-8704-c61ed1f3cf50", "tag": "c3ee7473-18c6-41d0-9618-9cd0d0754b26"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:30.368729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:30.368729 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:30:30.381399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-92cf258e-a0f6-4a4f-a6ef-a8d88f33bbee req-16738889-34e8-49b3-8bac-508f7b2c40a9 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:30.381399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-92cf258e-a0f6-4a4f-a6ef-a8d88f33bbee req-16738889-34e8-49b3-8bac-508f7b2c40a9 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:30.396421 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-92cf258e-a0f6-4a4f-a6ef-a8d88f33bbee req-16738889-34e8-49b3-8bac-508f7b2c40a9 service nova] Creating event network-changed:c3ee7473-18c6-41d0-9618-9cd0d0754b26 for instance 9c381b9f-420f-4e11-8704-c61ed1f3cf50 on hv-cinder-80266 Jul 28 09:30:30.402221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-92cf258e-a0f6-4a4f-a6ef-a8d88f33bbee req-16738889-34e8-49b3-8bac-508f7b2c40a9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039585 Jul 28 09:30:30.403218 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 427/879] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:30.788837 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:30.789451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:30.799049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:30.799503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:30.800408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:30.800848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:31.006288 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:31.014710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:31.016432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:31.017591 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-747d3d23-1311-4a6a-8da2-25f2b05ad269 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.232662 Jul 28 09:30:31.018143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 453/880] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:30 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:31.321102 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:31.322046 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:31.328864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:31.329316 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:31.330095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:31.330523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:31.336703 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:31.338853 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:31.346460 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:31.346901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:31.347819 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:31.348294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:31.405906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ef080f11-a278-4aca-b189-c9a4b5c3f474 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 18398 microversion: 2.1 time: 0.088848 Jul 28 09:30:31.406546 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 428/881] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:31 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 18398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:31.478217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:31.486274 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ac21c346-855d-4749-a5f2-3e125dd1127d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.153857 Jul 28 09:30:31.486850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 454/882] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:31 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:32.038229 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:32.039013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:32.046885 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:32.047326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:32.048158 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:32.048591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:32.182123 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:32.191314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:32.192859 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:32.194030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-da2b57bf-3983-4400-bf5b-d2908ef56ab0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.161103 Jul 28 09:30:32.194752 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 429/883] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:32 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:32.417285 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:32.418397 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:32.425204 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:32.425639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:32.426525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:32.426979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:32.497932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0e65b59e-731e-424f-9453-7146fbab82d7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 19342 microversion: 2.1 time: 0.084082 Jul 28 09:30:32.499545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 455/884] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:32 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 19342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:32.502388 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:32.503005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:32.509180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:32.509624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:32.510401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:32.510838 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:32.640068 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:32.648726 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-97a68ec5-b775-4f92-8f31-855506268ca7 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.149062 Jul 28 09:30:32.648726 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 430/885] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:32 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:33.213019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:33.213707 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:33.221252 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:33.221722 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:33.222511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:33.222936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:33.359569 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:33.367788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:33.369267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:33.370451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6c4ef417-ccb1-4ec6-b584-d7c589144dec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.161621 Jul 28 09:30:33.370947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 456/886] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:33 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:33.508985 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:33.510543 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:33.517300 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:33.517745 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:33.518664 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:33.519098 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:33.580847 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3015ac5f-b26c-4588-9fdf-3b91313d7826 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 21966 microversion: 2.1 time: 0.075543 Jul 28 09:30:33.581521 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 431/887] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:33 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 21966 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:33.665831 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:33.666514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:33.673430 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:33.674490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:33.674729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:33.675380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:33.806328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:33.814014 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0a88f7ab-d39a-4248-a2ac-af71c26d3aaa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.152114 Jul 28 09:30:33.814715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 457/888] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:33 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:34.388970 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:34.389698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:34.396292 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:34.396736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:34.397527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:34.397955 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:34.526049 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:34.535822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:34.537386 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:34.538548 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-52a288f3-0701-41f0-b6b8-aed8a77bdc42 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.153640 Jul 28 09:30:34.539109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 432/889] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:34 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:34.593189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:34.594110 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:34.603249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:34.603564 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:34.604376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:34.604811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:34.673366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d0701b47-3eba-4fe9-8353-4640505257e3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 23226 microversion: 2.1 time: 0.084337 Jul 28 09:30:34.677326 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 458/890] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:34 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 23226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:34.830310 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:34.831228 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:34.837601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:34.838056 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:34.838855 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:34.839327 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:34.980340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:34.988182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-213fada9-191d-4a19-abb1-1173c68d994b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.161630 Jul 28 09:30:34.988752 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 433/891] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:34 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:35.558367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:35.559106 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:35.566040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:35.566523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:35.567307 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:35.567788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:35.684829 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:35.685864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:35.693444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:35.693896 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:35.694688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:35.695127 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:35.697221 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:35.705514 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:35.707040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:35.708214 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5073c99c-85a4-4e9f-9a64-6c327b237307 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.154089 Jul 28 09:30:35.708762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 459/892] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:35 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:35.766593 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3a508063-bf8b-4845-8ee0-9bae0d4c0bc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 24166 microversion: 2.1 time: 0.085292 Jul 28 09:30:35.767362 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 434/893] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:35 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 24166 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:30:36.005069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:36.005784 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:36.011565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.012037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.012839 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.013260 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.140532 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:36.147727 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8b4bfab0-ae20-48cb-99df-17733c16267d tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.146251 Jul 28 09:30:36.148355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 460/894] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:36 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:36.730619 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:36.731751 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:36.738735 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.739187 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.739993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.740427 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.748209 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-b6579178-cc8e-47c4-b912-d7d84a3dbfa4 req-1b5c0329-c0af-4ec9-9562-3b3509246f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c381b9f-420f-4e11-8704-c61ed1f3cf50", "name": "network-vif-plugged", "status": "completed", "tag": "c3ee7473-18c6-41d0-9618-9cd0d0754b26"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:36.750594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:36.750594 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:30:36.758770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-b6579178-cc8e-47c4-b912-d7d84a3dbfa4 req-1b5c0329-c0af-4ec9-9562-3b3509246f42 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.759340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-b6579178-cc8e-47c4-b912-d7d84a3dbfa4 req-1b5c0329-c0af-4ec9-9562-3b3509246f42 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.775878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-b6579178-cc8e-47c4-b912-d7d84a3dbfa4 req-1b5c0329-c0af-4ec9-9562-3b3509246f42 service nova] Creating event network-vif-plugged:c3ee7473-18c6-41d0-9618-9cd0d0754b26 for instance 9c381b9f-420f-4e11-8704-c61ed1f3cf50 on hv-cinder-80266 Jul 28 09:30:36.780991 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-b6579178-cc8e-47c4-b912-d7d84a3dbfa4 req-1b5c0329-c0af-4ec9-9562-3b3509246f42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Jul 28 09:30:36.781903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 461/895] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:30:36.786711 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:36.787742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:36.794199 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.794641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.795424 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:36.795893 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:36.904915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-92250e14-4888-4042-8dc6-096e57ca8460 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 25548 microversion: 2.1 time: 0.121608 Jul 28 09:30:36.907614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 462/896] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:36 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 25548 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:36.923661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:36.931567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:36.933080 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:36.934222 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9d44deb8-7fc3-478d-8ef9-fd512d5b711a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.209751 Jul 28 09:30:36.935525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 435/897] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:36 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:37.165280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:37.165989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:37.173099 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:37.173549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:37.174325 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:37.174765 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:37.300937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:37.308137 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-51fff78e-de5c-41ff-84a2-2741d00f0176 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1318 microversion: 2.1 time: 0.146919 Jul 28 09:30:37.308697 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 463/898] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:37 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:30:37.916466 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:37.917378 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:37.924268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:37.924715 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:37.925476 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:37.925904 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:37.953227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:37.953861 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:37.959793 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:37.960239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:37.961003 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:37.961432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:37.989527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6455dba8-f15e-4f0d-bc52-42c3be4aaf34 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 26467 microversion: 2.1 time: 0.076600 Jul 28 09:30:37.991051 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 436/899] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:37 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 26467 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:38.087766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:38.096354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:38.097836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:38.098976 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1794250b-b981-46ed-9bd8-75d96a7ed82d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.149627 Jul 28 09:30:38.099523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 464/900] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:37 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:30:38.325914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:38.326652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:38.333072 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:38.333515 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:38.334278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:38.334710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:38.466645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:38.474342 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fdbbb896-f2dc-4d39-b77c-883f5fff4919 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1507 microversion: 2.1 time: 0.152943 Jul 28 09:30:38.474912 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 437/901] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:38 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:38.493901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3276f1c9-c775-4e8e-9db5-fa1b9d50540f", "device": "/dev/sdb"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:38.495816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:38.502642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:38.503097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:38.504019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:38.504454 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:38.755608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d81adb32-1541-4f2e-9a8a-b68e2e1ed2fa tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "POST /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265374 Jul 28 09:30:38.756599 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 465/902] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:30:38 2021] POST /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:39.001119 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:39.002037 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:39.007928 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:39.008317 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:39.009081 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:39.009516 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:39.070282 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8b4cfaa8-23ae-4574-acc0-24b628be9751 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 27268 microversion: 2.1 time: 0.072634 Jul 28 09:30:39.071032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 438/903] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:38 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 27268 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:39.117395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:39.118114 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:39.124119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:39.124552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:39.125303 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:39.125729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:39.250931 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:39.259444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:39.260955 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:39.262102 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4e10e0ec-fbf0-4361-9cd9-0b7de989f8ce tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.148765 Jul 28 09:30:39.263163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 466/904] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:39 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:40.082457 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:40.083371 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:40.089863 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:40.090303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:40.091096 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:40.091619 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:40.162027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9b86ffc0-629c-446c-b2f8-309765623e5e tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 27773 microversion: 2.1 time: 0.083616 Jul 28 09:30:40.162650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 439/905] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:40 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 27773 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:40.281892 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:40.282501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:40.288751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:40.289190 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:40.289947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:40.290375 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:40.409609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:40.417215 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:40.418725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:40.420408 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7f1c89fc-33e8-411d-ad8b-e4838554a407 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.142722 Jul 28 09:30:40.420957 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 467/906] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:40 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:41.174553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:41.175479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:41.181882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:41.182338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:41.183102 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:41.183534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:41.253288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-b6675134-efb8-459d-b9ee-c265372bae22 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28060 microversion: 2.1 time: 0.082696 Jul 28 09:30:41.254142 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 440/907] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:41 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28060 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:30:41.438718 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:41.439239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:41.445087 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:41.445529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:41.446279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:41.446705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:41.571103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:41.578709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:41.580234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:41.581359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c74cf3f6-10bb-4492-9fa1-084da7ebc38b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.147005 Jul 28 09:30:41.581908 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 468/908] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:41 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:42.265945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:42.266962 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:42.273459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:42.273911 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:42.274686 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:42.275128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:42.341471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0a1e26e0-9c31-40da-8d3d-8c3e06386f89 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28143 microversion: 2.1 time: 0.079363 Jul 28 09:30:42.342100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 441/909] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:42 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:42.598947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:42.599492 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:42.606053 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:42.606556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:42.607814 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:42.608253 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:42.726884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:42.734734 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:42.736275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:42.737426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ff3aceaf-3e7d-44fc-80e9-ac7d589d917e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.142269 Jul 28 09:30:42.737981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 469/910] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:42 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:43.353633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:43.354578 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:43.361103 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:43.361554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:43.362323 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:43.362762 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:43.428322 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8913cc93-cde3-4002-99f9-01287b581d82 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28143 microversion: 2.1 time: 0.078516 Jul 28 09:30:43.429077 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 442/911] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:43 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28143 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:43.756005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:43.756609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:43.762459 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:43.762854 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:43.763635 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:43.764064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:43.882516 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:43.890182 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:43.891676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:43.892806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-87642897-d1b7-46e6-97a7-9e958a4fcf7c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.140627 Jul 28 09:30:43.893361 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 470/912] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:43 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:44.440947 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:44.441958 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:44.449652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:44.450921 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:44.452271 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:44.452712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:44.522586 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-116bd33c-5a38-496c-8d54-7c9d8d919020 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28434 microversion: 2.1 time: 0.085548 Jul 28 09:30:44.523202 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 443/913] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:44 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28434 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:44.910127 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:44.910733 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:44.916407 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:44.916848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:44.917687 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:44.918286 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:45.045097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:45.052673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:45.054152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:45.055275 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ae163737-034e-46bb-a393-1bf9d35db1ae tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1743 microversion: 2.20 time: 0.148885 Jul 28 09:30:45.055860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 471/914] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:44 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:45.535566 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:45.536538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:45.542941 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:45.543413 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:45.545043 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:45.545477 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:45.622679 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ea9f02bf-d138-49bf-afa6-95c6c1d550a3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28434 microversion: 2.1 time: 0.090789 Jul 28 09:30:45.623611 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 444/915] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:45 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28434 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:46.073510 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:46.074125 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:46.079996 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:46.080528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:46.081281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:46.081719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:46.209856 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:46.219205 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:46.220751 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:46.221887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b430ad61-4e98-435d-97d7-ed6e6ec4bb0a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.152152 Jul 28 09:30:46.233621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 472/916] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:46 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:46.634545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:46.635589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:46.660462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:46.660462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:46.661084 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:46.665707 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:47.246113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:47.246749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:47.253207 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:47.253816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:47.254630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:47.255031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:47.394070 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:47.403790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:47.406376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:47.407959 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-608e7dae-66c4-4985-830a-987eb28f93cc tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.170005 Jul 28 09:30:47.422559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 473/917] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:47 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:48.436032 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:48.440239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:48.448872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:48.453869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:48.456419 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:48.457675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:48.611290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:48.621806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:48.623339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:48.624550 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6492e935-2e3d-4ad3-b7c4-9b6a23881356 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.197494 Jul 28 09:30:48.625651 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 474/918] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:48 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:30:49.645010 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:49.645754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:49.652370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:49.653419 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:49.654505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:49.655081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:49.793700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:49.811609 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:49.813183 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:49.816074 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0a98079d-5d8d-4197-a08b-ee52da1e42b6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.175669 Jul 28 09:30:49.816074 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 475/919] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:49 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:49.830599 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e3e96a28-1843-4fac-8e88-a5f3d5d8a56c tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28602 microversion: 2.1 time: 3.199862 Jul 28 09:30:49.833085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 445/920] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:46 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28602 bytes in 3203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:50.834223 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:50.835719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:50.842523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:50.844180 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:50.854554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:50.857451 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:50.857905 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:50.858688 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:50.859146 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:50.862299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:50.863131 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:50.863590 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:50.957917 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-031901a0-2734-4ee7-8522-ee0f072d5972 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28602 microversion: 2.1 time: 0.118278 Jul 28 09:30:50.962644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 446/921] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:50 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28602 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:51.004677 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:51.012921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:51.014458 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:51.015634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4eaf0214-fbc4-4de3-b760-fd38ddfac9c6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.185277 Jul 28 09:30:51.016197 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 476/922] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:50 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:51.971506 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:51.973291 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:51.983161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:51.983631 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:51.984662 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:51.985099 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:52.034877 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:52.035513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:52.048091 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:52.048774 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:52.049610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:52.050229 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:52.205286 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:52.215221 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:52.217380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:52.219134 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c044cf10-15fc-48e5-a162-c170aca2fc98 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.187881 Jul 28 09:30:52.220224 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 477/923] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:52 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:52.232161 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-9773e95e-24a8-4bff-936f-e6ce15907444 req-6631b87e-0341-4393-84e5-9cd0d8dd84be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "name": "network-vif-plugged", "status": "completed", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:52.234587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:30:52.234587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:30:52.243079 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-9773e95e-24a8-4bff-936f-e6ce15907444 req-6631b87e-0341-4393-84e5-9cd0d8dd84be service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:52.244156 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-9773e95e-24a8-4bff-936f-e6ce15907444 req-6631b87e-0341-4393-84e5-9cd0d8dd84be service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:52.258433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-9773e95e-24a8-4bff-936f-e6ce15907444 req-6631b87e-0341-4393-84e5-9cd0d8dd84be service nova] Creating event network-vif-plugged:9b6651ac-a2a9-45c2-85c4-d67031aa172a for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 on hv-cinder-80266 Jul 28 09:30:52.265494 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-9773e95e-24a8-4bff-936f-e6ce15907444 req-6631b87e-0341-4393-84e5-9cd0d8dd84be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038536 Jul 28 09:30:52.266750 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 478/924] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:30:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:30:53.242571 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:53.243294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:53.251922 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:53.252450 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:53.253309 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:53.253815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:53.396555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:53.405656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:53.407272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:53.408710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6d7c6ccf-f092-43a0-bd3f-21db2fe66662 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.172587 Jul 28 09:30:53.414584 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 479/925] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:53 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:30:54.003020 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9c486790-59da-4b58-b63f-ed44a5673cef tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28602 microversion: 2.1 time: 2.035304 Jul 28 09:30:54.007221 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 447/926] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:51 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28602 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:54.429985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:54.430585 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:54.436829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:54.437358 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:54.438360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:54.441666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:54.651608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:54.660083 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:54.661598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:54.663025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e2b2bbd5-d3f5-41c2-bea5-61105b13eae9 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1738 microversion: 2.20 time: 0.237140 Jul 28 09:30:54.681505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 480/927] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:54 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:30:55.015428 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:55.016459 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:55.023038 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:55.023539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:55.024405 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:55.025097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:55.163011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c2fda6d5-f474-46d4-8b71-53b883da7888 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28602 microversion: 2.1 time: 0.151680 Jul 28 09:30:55.164094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 448/928] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:55 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:55.688597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:55.689213 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:55.695417 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:55.695911 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:55.696689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:55.697128 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:55.868945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:55.877299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:55.878809 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:55.879981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8f9c5545-d5a6-4925-b2ad-92d3f33db6f3 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1720 microversion: 2.20 time: 0.195162 Jul 28 09:30:55.880544 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 481/929] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:55 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:56.175215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:56.176257 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:56.182657 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:56.183108 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:56.184455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:56.184876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:56.255242 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-284030a3-f45f-4c8a-a4d6-d85cb6a0c785 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28602 microversion: 2.1 time: 0.083910 Jul 28 09:30:56.256201 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 449/930] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:56 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28602 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:30:56.898614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:56.899238 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:56.906160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:56.906608 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:56.907379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:56.907841 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:57.030864 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:57.038673 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:57.040442 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:57.041573 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-13a9faa2-f0d6-4944-826d-af781a8f207a tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1720 microversion: 2.20 time: 0.146896 Jul 28 09:30:57.042113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 482/931] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:56 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:57.268110 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:57.269114 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:57.275634 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:57.276022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:57.277047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:57.277473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:57.341989 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d762c2b0-ca34-493c-9c72-d00710b0e458 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28602 microversion: 2.1 time: 0.077783 Jul 28 09:30:57.342644 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 450/932] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:57 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28602 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:58.058722 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:58.059365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:58.065081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:58.065525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:58.066279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:58.066704 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:58.136736 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:58.137498 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:58.144832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:58.145283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:58.146069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:58.146542 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:58.203618 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:58.213035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:58.214770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:58.216685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-33c2c402-eb75-44cb-b818-20aacd2179f5 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1720 microversion: 2.20 time: 0.161904 Jul 28 09:30:58.217239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 483/933] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:58 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:58.235252 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'services' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:30:58.301465 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e449f872-c4df-4e74-9415-736255405450 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50/os-volume_attachments/3276f1c9-c775-4e8e-9db5-fa1b9d50540f" status: 202 len: 0 microversion: 2.1 time: 0.168666 Jul 28 09:30:58.302392 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 451/934] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:30:58 2021] DELETE /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50/os-volume_attachments/3276f1c9-c775-4e8e-9db5-fa1b9d50540f => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:30:58.353296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:58.354220 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:58.367947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:58.368354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:58.369295 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:58.369815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:58.596067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1f3a21cc-cd39-4a6f-889f-934abbdf19b2 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 28720 microversion: 2.1 time: 0.246273 Jul 28 09:30:58.596656 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 484/935] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:58 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 28720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:59.235346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:59.236071 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:59.242770 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.243225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.244095 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.244566 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.366913 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:59.376062 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:59.377555 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:59.378699 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-029f01ef-ded3-4a23-b138-52abeabf4047 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1663 microversion: 2.20 time: 0.148297 Jul 28 09:30:59.379455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 452/936] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:30:59 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:30:59.396232 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00a2bf51-1771-4ab3-887c-892d14a474d3"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:59.397368 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:59.403985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.404423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.405189 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.405615 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.426537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:59.427035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:59.432819 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.433271 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.434765 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.435288 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.460305 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:30:59.537706 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8b698881-5edf-46dc-b552-cbe6fed8f75e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 204 len: 0 microversion: 2.1 time: 0.114141 Jul 28 09:30:59.538677 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 453/937] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:30:59 2021] DELETE /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:30:59.548491 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:59.549376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:59.555530 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.556023 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.556819 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.557234 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.674610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-6f70099c-7874-485a-bdde-ced43764a3ff tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282366 Jul 28 09:30:59.675262 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 485/938] 10.222.0.23 () {62 vars in 1364 bytes} [Wed Jul 28 09:30:59 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:30:59.679729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:30:59.680934 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:59.687825 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.688251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:30:59.688392 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.689167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.689612 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.696742 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0eddadeb-ecb5-436f-a153-e84d2f13d31e tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1513 microversion: 2.1 time: 0.153667 Jul 28 09:30:59.697311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 454/939] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:30:59 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:30:59.745176 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:30:59.745666 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:30:59.751896 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.752336 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.753090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:30:59.753518 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:30:59.770884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ffc64f50-2fcf-424c-8637-13dec06ff566 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 30153 microversion: 2.1 time: 0.094353 Jul 28 09:30:59.774771 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 486/940] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:30:59 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 30153 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:30:59.999511 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ee6bc54f-a4ad-4484-8e16-928096129e99 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/os-volume_attachments/00a2bf51-1771-4ab3-887c-892d14a474d3" status: 202 len: 0 microversion: 2.20 time: 0.258041 Jul 28 09:31:00.000151 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 455/941] 10.222.0.23 () {60 vars in 1457 bytes} [Wed Jul 28 09:30:59 2021] DELETE /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/os-volume_attachments/00a2bf51-1771-4ab3-887c-892d14a474d3 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:31:00.061752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:00.062405 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:00.068932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.069376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.070143 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.070571 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.094510 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-b7fc41c9-e6ad-44b3-acdd-c736b08274a1 req-a50aca86-c476-439e-8d6e-2810f1745b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "name": "network-vif-unplugged", "status": "completed", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:00.096253 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:00.096253 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:31:00.104278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-b7fc41c9-e6ad-44b3-acdd-c736b08274a1 req-a50aca86-c476-439e-8d6e-2810f1745b20 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.104898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-b7fc41c9-e6ad-44b3-acdd-c736b08274a1 req-a50aca86-c476-439e-8d6e-2810f1745b20 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.116560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.compute.server_external_events [req-b7fc41c9-e6ad-44b3-acdd-c736b08274a1 req-a50aca86-c476-439e-8d6e-2810f1745b20 service nova] Unable to find a host for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520. Dropping event network-vif-unplugged {{(pid=107292) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 28 09:31:00.117469 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-b7fc41c9-e6ad-44b3-acdd-c736b08274a1 req-a50aca86-c476-439e-8d6e-2810f1745b20 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027212 Jul 28 09:31:00.118227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 456/942] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:00 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 09:31:00.151560 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c2be3937-54c8-403a-ba63-78e613678cc6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action" status: 202 len: 0 microversion: 2.20 time: 0.094168 Jul 28 09:31:00.152406 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 487/943] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Jul 28 09:31:00 2021] POST /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 09:31:00.160200 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:00.160882 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:00.173976 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.174523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.175318 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.175830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.306486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:00.314628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:00.316138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:00.317337 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d566995a-e770-4272-b376-fe928f572693 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1671 microversion: 2.20 time: 0.160764 Jul 28 09:31:00.317918 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 457/944] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:00 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:00.714191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:00.714819 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:00.722053 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.722495 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.723504 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.723961 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.783837 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:00.785412 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:00.791280 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.791769 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.792537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:00.792972 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:00.853058 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:00.860409 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2eed1814-ffaf-4699-8409-c450052f1ef9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1513 microversion: 2.1 time: 0.149981 Jul 28 09:31:00.860972 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 488/945] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:00 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:00.876738 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-59f22cea-aebf-4d1c-b3f2-47eea29219cc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 31357 microversion: 2.1 time: 0.096608 Jul 28 09:31:00.880641 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 458/946] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:31:00 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 31357 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:31:01.336140 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:01.336805 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:01.343949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:01.344394 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:01.345172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:01.345637 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:01.539013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:01.546798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:01.548332 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:01.549470 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-17569739-8bbb-435f-ad30-44df1a519f6b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.217142 Jul 28 09:31:01.550037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 489/947] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:01 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:01.878370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:01.879191 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:01.886122 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:01.886560 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:01.888074 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:01.888511 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:01.888906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:01.889888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:01.897064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:01.897520 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:01.898301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:01.898743 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:01.965391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-31f86843-a323-444d-a5e9-f416018a057f tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 32567 microversion: 2.1 time: 0.080583 Jul 28 09:31:01.966152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 490/948] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:31:01 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 32567 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 09:31:02.414520 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:02.422473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-126f6995-a7a2-45d0-81ae-8cf0af9c82b5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1513 microversion: 2.1 time: 0.548110 Jul 28 09:31:02.423041 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 459/949] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:01 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1513 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:02.568237 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:02.568937 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:02.574664 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-e9a25d12-b3b2-49df-a1ef-e3145a7de15e req-a8259f48-54eb-4e86-b682-e9b03e082be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c381b9f-420f-4e11-8704-c61ed1f3cf50", "name": "network-vif-deleted", "tag": "c3ee7473-18c6-41d0-9618-9cd0d0754b26"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:02.576537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:02.576537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:31:02.577023 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:02.577805 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:02.578566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:02.579019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:02.585022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-e9a25d12-b3b2-49df-a1ef-e3145a7de15e req-a8259f48-54eb-4e86-b682-e9b03e082be0 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:02.585523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-e9a25d12-b3b2-49df-a1ef-e3145a7de15e req-a8259f48-54eb-4e86-b682-e9b03e082be0 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:02.600573 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-e9a25d12-b3b2-49df-a1ef-e3145a7de15e req-a8259f48-54eb-4e86-b682-e9b03e082be0 service nova] Creating event network-vif-deleted:c3ee7473-18c6-41d0-9618-9cd0d0754b26 for instance 9c381b9f-420f-4e11-8704-c61ed1f3cf50 on hv-cinder-80266 Jul 28 09:31:02.607436 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-e9a25d12-b3b2-49df-a1ef-e3145a7de15e req-a8259f48-54eb-4e86-b682-e9b03e082be0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037288 Jul 28 09:31:02.608063 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 460/950] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:31:02.717255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:02.724954 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:02.726391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:02.727511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9531f1ac-6c57-4306-a3ba-a15e552e7e00 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.163666 Jul 28 09:31:02.728095 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 491/951] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:02 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:02.978039 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:02.979771 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:02.987105 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:02.988085 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:02.989106 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:02.989772 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:03.441133 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:03.442355 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:03.448906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:03.449427 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:03.450882 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:03.451327 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:03.480763 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:03.481296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:03.481748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:03.519913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:03.527248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-33356419-d5fc-4b24-a5c8-254a5cd5f8b2 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.090759 Jul 28 09:31:03.528210 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 492/952] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:03 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:03.749792 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:03.750436 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:03.757568 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:03.758265 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:03.759298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:03.759925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:03.884990 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:03.892958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:03.894455 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:03.895611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-caefe53c-4c8f-4b73-a930-97467e0d5385 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.153186 Jul 28 09:31:03.896163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 493/953] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:03 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:04.546910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:04.548592 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:04.555873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:04.556595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:04.557380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:04.557812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:04.588935 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:04.589392 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:04.589841 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:04.629261 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:04.636343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a2e13261-0730-4edf-ad44-c68d4d84897b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.094656 Jul 28 09:31:04.636897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 494/954] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:04 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:04.913705 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:04.914316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:04.921160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:04.921604 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:04.922369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:04.922808 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:05.052446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:05.061096 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:05.062606 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:05.063785 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0dae420d-c1ed-45b4-ae18-56fe0eb1475d tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.153795 Jul 28 09:31:05.064343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 495/955] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:04 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:05.653826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:05.654520 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:05.660281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:05.660726 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:05.661487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:05.661920 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:05.693840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:05.694632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:05.696082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:05.747554 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:05.755684 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5e4655fe-29d6-43ae-a8eb-13e80ec1bec3 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.106461 Jul 28 09:31:05.756257 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 496/956] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:05 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:06.081925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:06.082565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:06.088526 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:06.088975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:06.089747 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:06.090254 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:06.214263 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:06.223772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:06.225366 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:06.226595 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f2a41b50-088a-4c2c-9c87-806940291b44 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.148543 Jul 28 09:31:06.231113 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 497/957] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:06 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:06.772790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:06.773569 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:06.779945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:06.780405 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:06.781191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:06.781628 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:06.812545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:06.812989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:06.813437 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:06.853063 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:06.861918 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-313d351a-6d1d-49b3-b4cf-95871a185b66 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.092819 Jul 28 09:31:06.873657 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 498/958] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:06 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:07.247103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:07.247819 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:07.253894 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:07.254328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:07.255103 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:07.255534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:07.387748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:07.395412 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:07.397173 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:07.398296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f537bc10-2538-4baa-9075-404cea1afbd2 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.155469 Jul 28 09:31:07.398849 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 499/959] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:07 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:07.880449 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:07.881255 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:07.887481 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:07.887979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:07.888765 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:07.889195 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:07.922138 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:07.922584 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:07.923031 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:07.960872 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:07.968842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fd917af9-296b-47c7-837c-e634c36eaf3c tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.092125 Jul 28 09:31:07.969626 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 500/960] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:07 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:08.416887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:08.417530 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:08.423446 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:08.423984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:08.424753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:08.425185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:08.559338 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:08.567998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:08.569499 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:08.570642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e82023b3-3c93-4849-9286-f5c3ff6675bb tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.157686 Jul 28 09:31:08.571198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 501/961] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:08 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:08.985024 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:08.985732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:08.991536 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:08.992017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:08.992786 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:08.993222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:09.023658 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:09.024110 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:09.024557 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:09.069326 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:09.078984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-683a76cd-cf82-4422-ba8e-28db418795e5 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.097564 Jul 28 09:31:09.082444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 502/962] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:08 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:09.590470 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:09.591460 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:09.597615 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:09.598059 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:09.598820 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:09.599246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:09.727314 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:09.735830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:09.737324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:09.738465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d5c9275b-0e6c-4e0c-88da-235cf1f32587 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.152529 Jul 28 09:31:09.739304 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 503/963] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:09 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:10.102490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:10.103365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:10.110549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:10.111015 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:10.111879 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:10.112280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:10.150216 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:10.150917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:10.151660 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:10.196830 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:10.204342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ef185b08-bdfc-4b44-9a75-0dda191af7b9 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.105537 Jul 28 09:31:10.205170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 504/964] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:10 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:10.757172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:10.757798 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:10.764287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:10.764728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:10.765487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:10.765915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:10.890000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:10.898097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:10.899681 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:10.900892 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a282c9ab-6299-437d-87b3-6132bccb8cbe tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.147465 Jul 28 09:31:10.901720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 505/965] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:10 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:11.221361 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:11.222198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:11.227806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.228267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.229038 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.229475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.260672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.261118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.261566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:11.304139 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:11.312106 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1f428dea-7839-4bda-a9d4-48bfb50ba5a1 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.094533 Jul 28 09:31:11.312677 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 506/966] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:11 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:11.316939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1381115717"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:11.317471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:11.323243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.323724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.324645 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.325276 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.457384 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.network.security_group_api [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Removing security group 273126ff-0cda-46ea-b1e2-a3a68e803c1d from port 7bab243d-b602-40fd-a545-e20c1ce70bfa Jul 28 09:31:11.807632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-042fba3b-24bb-4171-b6b8-a7a8e6edfb03 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/action" status: 202 len: 0 microversion: 2.1 time: 0.493772 Jul 28 09:31:11.813187 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 507/967] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:31:11 2021] POST /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:11.875093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-7cf581a6-12ef-473e-b2a5-a396bc6f468b req-3a0da4df-4601-44cc-8ed6-a6ddceb36912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:11.881950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:11.881950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:31:11.891846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-7cf581a6-12ef-473e-b2a5-a396bc6f468b req-3a0da4df-4601-44cc-8ed6-a6ddceb36912 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.892775 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-7cf581a6-12ef-473e-b2a5-a396bc6f468b req-3a0da4df-4601-44cc-8ed6-a6ddceb36912 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.907813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-7cf581a6-12ef-473e-b2a5-a396bc6f468b req-3a0da4df-4601-44cc-8ed6-a6ddceb36912 service nova] Creating event network-changed:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:31:11.916402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-7cf581a6-12ef-473e-b2a5-a396bc6f468b req-3a0da4df-4601-44cc-8ed6-a6ddceb36912 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054269 Jul 28 09:31:11.918710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 508/968] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:31:11.926467 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:11.927544 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:11.935098 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.936105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:11.937145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:11.937801 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:12.137632 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:12.147203 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:12.148834 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:12.150023 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d90399c6-c8ca-47d8-afd1-9c341e0bdaef tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.229012 Jul 28 09:31:12.161481 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 509/969] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:11 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:12.329624 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:12.330305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:12.335939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:12.336388 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:12.337176 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:12.337613 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:12.369523 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:12.369978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:12.370428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:12.419945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:12.428083 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bfed1b50-a710-45de-a2fc-64eeb8ccc46b tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.102050 Jul 28 09:31:12.428996 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 510/970] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:12 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:13.176602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:13.177488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:13.184626 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.185469 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.186423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.187014 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.362484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:13.372859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:13.374533 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:13.375996 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a502102f-1e34-4b28-92e9-49d323e980de tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.210429 Jul 28 09:31:13.377104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 511/971] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:13 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:13.382198 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:13.382920 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:13.390524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.391296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.392641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.393804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.492526 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lazy-loading 'services' on Instance uuid 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:13.560092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-210d37b0-25e3-4eab-9319-c214ea3a4fa2 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments/063ff76d-87a8-4081-bd0a-bdd9b8139ea7" status: 202 len: 0 microversion: 2.1 time: 0.181155 Jul 28 09:31:13.560884 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 512/972] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:31:13 2021] DELETE /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments/063ff76d-87a8-4081-bd0a-bdd9b8139ea7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:13.569054 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-b6ceffa5-58ae-4fe2-b9a8-a029331e47d8 req-7e1b7aa8-279d-46da-8e12-f2485e248556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:13.570602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:13.570602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:31:13.577992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-b6ceffa5-58ae-4fe2-b9a8-a029331e47d8 req-7e1b7aa8-279d-46da-8e12-f2485e248556 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.578444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-b6ceffa5-58ae-4fe2-b9a8-a029331e47d8 req-7e1b7aa8-279d-46da-8e12-f2485e248556 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.590343 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-b6ceffa5-58ae-4fe2-b9a8-a029331e47d8 req-7e1b7aa8-279d-46da-8e12-f2485e248556 service nova] Creating event network-changed:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:31:13.595956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-b6ceffa5-58ae-4fe2-b9a8-a029331e47d8 req-7e1b7aa8-279d-46da-8e12-f2485e248556 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030689 Jul 28 09:31:13.599377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 513/973] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:13.604712 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:13.605941 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:13.612287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.612728 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.613528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.613957 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.646490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.646927 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.647379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:13.694902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:13.710424 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4e247ec8-3dcd-4ce0-a47b-22452ba90148 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.103695 Jul 28 09:31:13.710424 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 514/974] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:13 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:13.718487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:13.718487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:13.723287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.723914 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.724846 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:13.725371 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:13.772127 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ea8c7951-dccb-4d5a-9ed5-0ca455c34983 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065912 Jul 28 09:31:13.773266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 515/975] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Jul 28 09:31:13 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:14.396287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:14.397346 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:14.414484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.414936 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.415809 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.416267 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.552561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:14.560945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:14.562431 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:14.563675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-15ab4865-8d4d-4cac-bfba-d616df7becf0 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.172726 Jul 28 09:31:14.564388 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 516/976] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:14 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:14.721981 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:14.722513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:14.728454 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.728925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.729672 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.730111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.762797 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.763294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.763836 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lazy-loading 'fault' on Instance uuid 9c381b9f-420f-4e11-8704-c61ed1f3cf50 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:14.805727 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0395bff7c5848619b07ca4faf704ae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fc892898a594e59889bda5edf6fe6fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:14.813615 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4d226747-2c6a-4106-a883-b9c0838f2256 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 200 len: 1308 microversion: 2.1 time: 0.095413 Jul 28 09:31:14.814178 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 517/977] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:14 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:14.818478 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:14.819383 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:14.825365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.825811 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.826582 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:14.827016 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:14.854576 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-78b7e5cc-7764-46a6-96e3-bdadabd3dbd9 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039423 Jul 28 09:31:14.855115 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 518/978] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Jul 28 09:31:14 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:15.362112 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2ccb46c3-420d-41d8-9f2f-a49e030ad9e4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action" status: 200 len: 38249 microversion: 2.1 time: 12.388161 Jul 28 09:31:15.362823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 461/979] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Jul 28 09:31:02 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/action => generated 38249 bytes in 12390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 09:31:15.372998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:15.373497 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:15.379629 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.380081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.381064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.381494 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.406698 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5bdf7d92-4780-47ca-8430-88f7b954f8ad tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/ips" status: 200 len: 147 microversion: 2.1 time: 0.037630 Jul 28 09:31:15.407611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 519/980] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Jul 28 09:31:15 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:15.584202 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:15.585080 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:15.596149 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.596719 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.597692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.598294 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.803923 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:15.811828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:15.813358 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:15.814513 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6e320ee4-9952-4828-a436-f2d84cbf2ced tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.235443 Jul 28 09:31:15.815073 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 462/981] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:15 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:15.831825 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:15.832724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] [instance: 9c381b9f-420f-4e11-8704-c61ed1f3cf50] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:15.838670 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.839117 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.840480 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.840917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.854875 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] HTTP exception thrown: Instance 9c381b9f-420f-4e11-8704-c61ed1f3cf50 could not be found. Jul 28 09:31:15.855602 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] Returning 404 to user: Instance 9c381b9f-420f-4e11-8704-c61ed1f3cf50 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:15.856433 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1b0d6dfb-b49a-470d-ab1c-dc549025a773 tempest-VolumesSnapshotTestJSON-680838686 tempest-VolumesSnapshotTestJSON-680838686-project] 10.222.0.23 "GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50" status: 404 len: 111 microversion: 2.1 time: 0.028778 Jul 28 09:31:15.857289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 520/982] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:15 2021] GET /compute/v2.1/servers/9c381b9f-420f-4e11-8704-c61ed1f3cf50 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:31:15.867093 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:15.867776 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:15.875613 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.876279 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.877100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:15.877692 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:15.911429 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3b9b5538-adc1-4595-b210-c218a0d7699f tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Jul 28 09:31:15.912462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 463/983] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Jul 28 09:31:15 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:16.761803 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "297d8f35-5ebe-4a5c-9a85-e13d76de5d40"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:16.762881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:16.768720 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:16.769162 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:16.769917 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:16.770345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:16.834148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:16.834840 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:16.841887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:16.842399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:16.843233 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:16.843765 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:16.977760 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:16.986724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:16.988606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:16.989763 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e0823731-b026-48de-a692-0c198cbebdec tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.159513 Jul 28 09:31:16.990312 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 464/984] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:16 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:16.994642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:16.995545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:17.001784 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:17.002227 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:17.003027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:17.003429 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:17.008971 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-cee6bcbe-e296-4ae4-87d0-8e05532a54ed tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250650 Jul 28 09:31:17.009589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 521/985] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:31:16 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:17.034430 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-198f6bcc-2729-47f8-a0ca-45a4842363c0 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043074 Jul 28 09:31:17.034999 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 465/986] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Jul 28 09:31:16 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 09:31:17.046739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:17.047702 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:17.054575 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:17.055095 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:17.055924 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:17.056365 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:17.142045 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] HTTP exception thrown: Instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 is not attached to volume 063ff76d-87a8-4081-bd0a-bdd9b8139ea7 Jul 28 09:31:17.142643 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Returning 404 to user: Instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 is not attached to volume 063ff76d-87a8-4081-bd0a-bdd9b8139ea7 {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:17.143482 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-204225f9-26b3-469a-9244-89763d39ecfb tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments/063ff76d-87a8-4081-bd0a-bdd9b8139ea7" status: 404 len: 154 microversion: 2.1 time: 0.101994 Jul 28 09:31:17.144065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 522/987] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:31:17 2021] DELETE /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2/os-volume_attachments/063ff76d-87a8-4081-bd0a-bdd9b8139ea7 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:18.007624 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:18.008239 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:18.014242 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:18.014684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:18.015440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:18.015906 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:18.135211 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:18.143139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:18.144651 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:18.145775 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e5677dcf-7d51-4932-ae6e-818ad38b991e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.141879 Jul 28 09:31:18.146321 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 466/988] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:18 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:18.313763 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:18.314271 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:18.320574 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:18.321020 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:18.321790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:18.322224 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:18.346826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:31:18.419212 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-281d0e23-2a1e-4e9c-81b0-de4318fc4ac6 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 204 len: 0 microversion: 2.1 time: 0.108768 Jul 28 09:31:18.420006 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 523/989] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:31:18 2021] DELETE /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:31:18.428218 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:18.428831 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:18.435100 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:18.435544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:18.436332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:18.436759 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:18.554127 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:18.561279 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bdd1eb8a-2dd2-4e17-8739-239d70ef6c3a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1555 microversion: 2.1 time: 0.136857 Jul 28 09:31:18.561831 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 467/990] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:18 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1555 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:19.164260 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:19.164956 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:19.170749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:19.171187 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:19.171980 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:19.172409 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:19.297664 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:19.305308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:19.306790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:19.307940 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4b061393-3c9a-4514-9534-1525c7212d36 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.147607 Jul 28 09:31:19.309192 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 524/991] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:19 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:19.577919 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:19.578525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:19.584684 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:19.585125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:19.585877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:19.586303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:19.704866 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:19.712096 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-51ddc4fa-1ed6-4b2e-8ee6-649ec48d9ee5 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1555 microversion: 2.1 time: 0.137783 Jul 28 09:31:19.712591 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 468/992] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:19 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:20.327002 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:20.327639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:20.333878 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:20.334331 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:20.335104 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:20.335556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:20.453388 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:20.461061 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:20.462612 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:20.463764 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e711ef5e-ab2e-47a6-8ab3-90c8a3832791 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.141130 Jul 28 09:31:20.464314 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 525/993] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:20 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:20.728219 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:20.728759 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:20.734581 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:20.735024 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:20.735823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:20.736259 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:20.861706 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:20.868908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-83ee2ea6-dfe9-4fbe-aacb-4c72f9c844dc tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1555 microversion: 2.1 time: 0.144450 Jul 28 09:31:20.869468 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 469/994] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:20 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:21.483112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:21.483788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:21.489558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:21.489996 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:21.490749 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:21.491176 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:21.614908 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:21.623161 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:21.624666 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:21.625818 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1165aeb4-8116-404b-b3c7-fa86347890f6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.147319 Jul 28 09:31:21.626556 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 526/995] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:21 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:21.885973 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:21.886596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:21.892486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:21.892932 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:21.893698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:21.894138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:22.012781 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:22.020177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d5e2ad50-7e15-4a03-bf76-d59acfe32389 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1555 microversion: 2.1 time: 0.137853 Jul 28 09:31:22.020681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 470/996] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:21 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:22.601896 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-1d896a9f-93e5-4c00-a1ed-d8aa85e68f3a req-25aae9c5-bf33-4260-aa0c-7f038d8d5d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "name": "network-vif-plugged", "status": "completed", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:22.603790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:22.603790 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:31:22.612254 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-1d896a9f-93e5-4c00-a1ed-d8aa85e68f3a req-25aae9c5-bf33-4260-aa0c-7f038d8d5d56 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:22.612822 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-1d896a9f-93e5-4c00-a1ed-d8aa85e68f3a req-25aae9c5-bf33-4260-aa0c-7f038d8d5d56 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:22.625689 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-1d896a9f-93e5-4c00-a1ed-d8aa85e68f3a req-25aae9c5-bf33-4260-aa0c-7f038d8d5d56 service nova] Creating event network-vif-plugged:9b6651ac-a2a9-45c2-85c4-d67031aa172a for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 on hv-cinder-80266 Jul 28 09:31:22.630759 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-1d896a9f-93e5-4c00-a1ed-d8aa85e68f3a req-25aae9c5-bf33-4260-aa0c-7f038d8d5d56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033146 Jul 28 09:31:22.631624 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 527/997] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:31:22.650433 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:22.651649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:22.659839 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:22.660703 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:22.661841 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:22.662518 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:22.837349 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-0385376e-b338-43aa-afa7-6107c5744adf req-ea44b2ac-ece2-4064-8e78-6cd564deb1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a3ccc9f-c540-41f9-881a-edfbbeee60e2", "name": "network-vif-deleted", "tag": "7bab243d-b602-40fd-a545-e20c1ce70bfa"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:22.838974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:22.838974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:31:22.852293 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-0385376e-b338-43aa-afa7-6107c5744adf req-ea44b2ac-ece2-4064-8e78-6cd564deb1e5 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:22.852748 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-0385376e-b338-43aa-afa7-6107c5744adf req-ea44b2ac-ece2-4064-8e78-6cd564deb1e5 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:22.869209 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-0385376e-b338-43aa-afa7-6107c5744adf req-ea44b2ac-ece2-4064-8e78-6cd564deb1e5 service nova] Creating event network-vif-deleted:7bab243d-b602-40fd-a545-e20c1ce70bfa for instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 on hv-cinder-80266 Jul 28 09:31:22.877201 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-0385376e-b338-43aa-afa7-6107c5744adf req-ea44b2ac-ece2-4064-8e78-6cd564deb1e5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043978 Jul 28 09:31:22.877621 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 528/998] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:31:22.888419 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:22.906414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:22.912732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:22.914470 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fdb676d0-8333-482a-a56d-b6860fccfd1e tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.273172 Jul 28 09:31:22.926558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 471/999] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:22 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:23.038055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:23.038762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:23.045685 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:23.046144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:23.046963 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:23.047398 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:23.088034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:23.088692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:23.089300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lazy-loading 'fault' on Instance uuid 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:23.131921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3933a41da6e34894829b2b4028ef6005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7108c357a549b0a779fe9c24380ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:23.140250 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e5fe27ec-55e9-4c82-96ec-2fba6a50fc0a tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 200 len: 1349 microversion: 2.1 time: 0.106194 Jul 28 09:31:23.140832 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 529/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:23 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:23.933837 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:23.934479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:23.940900 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:23.941350 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:23.942125 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:23.942559 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.070190 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:24.078908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:24.080570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:24.081924 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-27be95d3-1939-4b99-9bf9-8bec3a5738a6 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1729 microversion: 2.20 time: 0.152243 Jul 28 09:31:24.082546 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 472/1001] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:23 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:24.158576 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:24.159525 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] [instance: 4a3ccc9f-c540-41f9-881a-edfbbeee60e2] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:24.167241 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:24.168180 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.170069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:24.170531 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.188233 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] HTTP exception thrown: Instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 could not be found. Jul 28 09:31:24.188890 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Returning 404 to user: Instance 4a3ccc9f-c540-41f9-881a-edfbbeee60e2 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:24.189744 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e4cbdaae-2062-41f6-b55e-b4760bd248ff tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2" status: 404 len: 111 microversion: 2.1 time: 0.035437 Jul 28 09:31:24.190300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 530/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:24 2021] GET /compute/v2.1/servers/4a3ccc9f-c540-41f9-881a-edfbbeee60e2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:24.198866 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3a796383-6aa1-4ec0-a9ad-93230db6bbd1 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] Calling method '.version_select at 0x7f16d0445f70>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:24.219161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3a796383-6aa1-4ec0-a9ad-93230db6bbd1 tempest-TestMinimumBasicScenario-898473436 tempest-TestMinimumBasicScenario-898473436-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1130295792" status: 202 len: 0 microversion: 2.1 time: 0.024329 Jul 28 09:31:24.222929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 473/1003] 10.222.0.23 () {58 vars in 1272 bytes} [Wed Jul 28 09:31:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1130295792 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:24.506589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:24.507611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:24.515557 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:24.516128 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.516998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:24.517504 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.550301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4208c8f0-7c06-49f0-9e34-c057ffad4820 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047503 Jul 28 09:31:24.550866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 531/1004] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Jul 28 09:31:24 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:24.561439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:24.562122 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:24.568971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:24.569472 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.570367 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:24.570820 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:24.607232 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f02b1a44-4450-483e-91b0-046d2b0e3c14 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/297d8f35-5ebe-4a5c-9a85-e13d76de5d40" status: 200 len: 194 microversion: 2.1 time: 0.050477 Jul 28 09:31:24.607851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 474/1005] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Jul 28 09:31:24 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/297d8f35-5ebe-4a5c-9a85-e13d76de5d40 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:25.100850 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:25.101580 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:25.107895 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:25.108333 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:25.109105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:25.109541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:25.385041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:25.394501 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:25.396131 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:25.397239 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2beb0e5f-dfdf-41f1-8e65-d0649277af4c tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1716 microversion: 2.20 time: 0.300224 Jul 28 09:31:25.397762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 532/1006] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:25 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1716 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:31:25.936162 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35b401a0-34f2-4403-a2c9-85416258391e"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:25.937363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:25.943289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:25.943765 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:25.944536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:25.944956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:28.971321 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7a700b84-eb41-4649-b5f4-b281aa57ad44 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.039515 Jul 28 09:31:28.972041 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 475/1007] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Jul 28 09:31:25 2021] POST /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments => generated 194 bytes in 3041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:36.547630 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:36.548559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:36.554795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:36.555246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:36.556040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:36.556476 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:36.586555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-245440de-16d6-4667-bbf9-9cf200b35dfd tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042640 Jul 28 09:31:36.587100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 533/1008] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Jul 28 09:31:36 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:36.819811 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:36.820343 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:36.826540 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:36.826978 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:36.827766 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:36.828203 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:36.857240 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fd1b77ce-e511-41d1-8c80-0b1b83162981 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/297d8f35-5ebe-4a5c-9a85-e13d76de5d40" status: 200 len: 194 microversion: 2.1 time: 0.042142 Jul 28 09:31:36.857822 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 476/1009] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Jul 28 09:31:36 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/297d8f35-5ebe-4a5c-9a85-e13d76de5d40 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:36.867124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:36.867674 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:36.874172 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:36.874622 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:36.875395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:36.875859 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:36.959301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lazy-loading 'services' on Instance uuid f8fc17a0-50df-4194-8803-370abbf93106 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:37.024593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-63744352-5a0d-41c4-af56-3eba37f8f9ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/297d8f35-5ebe-4a5c-9a85-e13d76de5d40" status: 202 len: 0 microversion: 2.1 time: 0.161106 Jul 28 09:31:37.025176 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 534/1010] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:31:36 2021] DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/297d8f35-5ebe-4a5c-9a85-e13d76de5d40 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:38.152174 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:38.152786 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:38.158804 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:38.159253 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:38.160067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:38.160504 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:38.191557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-af3f1e71-8db9-44f2-bcc4-0ffdaf3012c4 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/35b401a0-34f2-4403-a2c9-85416258391e" status: 200 len: 194 microversion: 2.1 time: 0.043355 Jul 28 09:31:38.192173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 477/1011] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Jul 28 09:31:38 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/35b401a0-34f2-4403-a2c9-85416258391e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:38.202715 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:38.203376 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:38.209548 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:38.210065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:38.210902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:38.211394 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:38.299219 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lazy-loading 'services' on Instance uuid f8fc17a0-50df-4194-8803-370abbf93106 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:38.362507 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1c5d0d98-1597-4e55-adb5-d343971d6a8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/35b401a0-34f2-4403-a2c9-85416258391e" status: 202 len: 0 microversion: 2.1 time: 0.163973 Jul 28 09:31:38.363076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 535/1012] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Jul 28 09:31:38 2021] DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106/os-volume_attachments/35b401a0-34f2-4403-a2c9-85416258391e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 09:31:39.694895 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:39.695390 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:39.702734 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:39.703182 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:39.703976 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:39.704449 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:39.733094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:31:39.811399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e243c6f7-51a1-4e78-8cbb-84c2f51579a7 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 204 len: 0 microversion: 2.1 time: 0.119807 Jul 28 09:31:39.816481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 478/1013] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:31:39 2021] DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:31:39.825840 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:39.826545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:39.832552 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:39.833002 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:39.833842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:39.834258 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:39.961012 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:39.970220 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7b3ad374-d162-470d-bfe3-5e2ff93d1d8a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1674 microversion: 2.1 time: 0.149063 Jul 28 09:31:39.970804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 536/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:39 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:40.987948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:40.988567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:40.994369 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:40.994810 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:40.995586 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:40.996099 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:41.117170 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:41.125264 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d8317639-f868-49dc-8dc8-597d672a984b tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1674 microversion: 2.1 time: 0.141522 Jul 28 09:31:41.125851 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 479/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:40 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1674 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:42.143109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:42.143933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:42.149876 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:42.150326 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:42.151400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:42.151858 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:42.240969 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6defae8d5f64f56ac3c5f3d3abd9aff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1f63fb540e42f18f0ec634cc138c04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:42.249069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab5049a5-9cab-4e18-a787-d5be5f2f1212 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 200 len: 1606 microversion: 2.1 time: 0.110194 Jul 28 09:31:42.249642 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 537/1016] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:42 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 1606 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:31:42.417244 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-ee6de411-34e4-416d-89c4-5767bdf02f6d req-c96073fe-e64d-4934-bb27-d511ff7b5d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fc17a0-50df-4194-8803-370abbf93106", "name": "network-vif-deleted", "tag": "9cebf7da-ff2a-47b7-8013-16bf419f7ead"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:42.419772 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:42.419772 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:31:42.429146 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-ee6de411-34e4-416d-89c4-5767bdf02f6d req-c96073fe-e64d-4934-bb27-d511ff7b5d19 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:42.430022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-ee6de411-34e4-416d-89c4-5767bdf02f6d req-c96073fe-e64d-4934-bb27-d511ff7b5d19 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:42.448563 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-ee6de411-34e4-416d-89c4-5767bdf02f6d req-c96073fe-e64d-4934-bb27-d511ff7b5d19 service nova] Creating event network-vif-deleted:9cebf7da-ff2a-47b7-8013-16bf419f7ead for instance f8fc17a0-50df-4194-8803-370abbf93106 on hv-cinder-80266 Jul 28 09:31:42.455311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-ee6de411-34e4-416d-89c4-5767bdf02f6d req-c96073fe-e64d-4934-bb27-d511ff7b5d19 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041266 Jul 28 09:31:42.456474 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 480/1017] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:43.266443 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:43.267082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:43.273445 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:43.273897 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:43.274738 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:43.275175 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:43.288709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] HTTP exception thrown: Instance f8fc17a0-50df-4194-8803-370abbf93106 could not be found. Jul 28 09:31:43.289316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Returning 404 to user: Instance f8fc17a0-50df-4194-8803-370abbf93106 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:43.290151 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7970c722-59d7-4522-a86b-46ce7bff83ff tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 404 len: 111 microversion: 2.1 time: 0.027454 Jul 28 09:31:43.290701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 538/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:43 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:43.299646 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7b33ee84-62cb-45ee-8b79-0e8d2b1a9742 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '.version_select at 0x7f16d076b8b0>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:43.318141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7b33ee84-62cb-45ee-8b79-0e8d2b1a9742 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374875866" status: 202 len: 0 microversion: 2.1 time: 0.022630 Jul 28 09:31:43.319712 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 481/1019] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Jul 28 09:31:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374875866 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:46.204465 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:46.204975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:46.210969 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:46.211423 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:46.212221 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:46.212692 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:46.225939 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] HTTP exception thrown: Instance f8fc17a0-50df-4194-8803-370abbf93106 could not be found. Jul 28 09:31:46.226524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Returning 404 to user: Instance f8fc17a0-50df-4194-8803-370abbf93106 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:46.227340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ae475be2-41ca-473d-934d-ef2a92d74cc3 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 404 len: 111 microversion: 2.1 time: 0.026687 Jul 28 09:31:46.227915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 539/1020] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:31:46 2021] DELETE /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:46.236148 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:46.236884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: f8fc17a0-50df-4194-8803-370abbf93106] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:46.242816 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:46.243255 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:46.244047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:46.244478 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:46.257984 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] HTTP exception thrown: Instance f8fc17a0-50df-4194-8803-370abbf93106 could not be found. Jul 28 09:31:46.258571 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Returning 404 to user: Instance f8fc17a0-50df-4194-8803-370abbf93106 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:46.259391 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d594e0f4-57b3-4f6e-9921-050a352ac596 tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106" status: 404 len: 111 microversion: 2.1 time: 0.027419 Jul 28 09:31:46.259946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 482/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:46 2021] GET /compute/v2.1/servers/f8fc17a0-50df-4194-8803-370abbf93106 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:31:47.391537 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:47.392088 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:47.397730 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:47.398170 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:47.398922 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:47.399344 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:47.413319 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] HTTP exception thrown: Instance a93e643c-a780-41fb-9719-43b374afe806 could not be found. Jul 28 09:31:47.413891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Returning 404 to user: Instance a93e643c-a780-41fb-9719-43b374afe806 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:47.414690 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-13179c0f-6937-4552-b42b-9cebfe97793a tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 404 len: 111 microversion: 2.1 time: 0.027641 Jul 28 09:31:47.415197 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 540/1022] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:31:47 2021] DELETE /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:47.423386 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:47.424020 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] [instance: a93e643c-a780-41fb-9719-43b374afe806] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:47.429656 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:47.430093 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:47.430846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:47.431272 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:47.444743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] HTTP exception thrown: Instance a93e643c-a780-41fb-9719-43b374afe806 could not be found. Jul 28 09:31:47.445318 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] Returning 404 to user: Instance a93e643c-a780-41fb-9719-43b374afe806 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:47.446120 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-256b49b8-8ad7-4798-902b-3fdb383d23dc tempest-AttachVolumeTestJSON-438161824 tempest-AttachVolumeTestJSON-438161824-project] 10.222.0.23 "GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806" status: 404 len: 111 microversion: 2.1 time: 0.026340 Jul 28 09:31:47.446621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 483/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:47 2021] GET /compute/v2.1/servers/a93e643c-a780-41fb-9719-43b374afe806 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:31:50.507046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:50.507563 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:50.521045 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-dea059d1-22df-46ea-b81c-638588a07d59 req-e7fd311b-d58b-4329-a98a-5af22c04c620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:50.522787 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:50.522787 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:31:50.527900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:50.528920 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:50.529707 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:50.530131 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:50.534574 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-dea059d1-22df-46ea-b81c-638588a07d59 req-e7fd311b-d58b-4329-a98a-5af22c04c620 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:50.540537 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-dea059d1-22df-46ea-b81c-638588a07d59 req-e7fd311b-d58b-4329-a98a-5af22c04c620 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:50.569468 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:31:50.580908 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-dea059d1-22df-46ea-b81c-638588a07d59 req-e7fd311b-d58b-4329-a98a-5af22c04c620 service nova] Creating event network-changed:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:31:50.588833 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-dea059d1-22df-46ea-b81c-638588a07d59 req-e7fd311b-d58b-4329-a98a-5af22c04c620 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071078 Jul 28 09:31:50.589683 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 484/1024] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:50.711294 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-86aa4b55-00a5-4998-83ce-c5941d295dbc tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "DELETE /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 204 len: 0 microversion: 2.1 time: 0.207496 Jul 28 09:31:50.712340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 541/1025] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:31:50 2021] DELETE /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:31:50.723994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:50.725185 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:50.734094 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:50.734550 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:50.735713 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:50.736138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:51.057557 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:51.066437 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c49e7e25-a175-47d8-8219-2debf6ff0fa7 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1570 microversion: 2.1 time: 0.348345 Jul 28 09:31:51.071331 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 485/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:50 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1570 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:51.871566 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3a41fcf9-7c01-47d9-8142-72529035b01f tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Action: 'create', calling method: .version_select at 0x7f16d033edc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1791612123"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:52.087947 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:52.088601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:52.095252 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:52.095722 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:52.096743 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:52.097373 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:52.154639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3a41fcf9-7c01-47d9-8142-72529035b01f tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.388654 Jul 28 09:31:52.155412 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 542/1027] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Jul 28 09:31:51 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 28 09:31:52.166287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-3c300c7c-2607-4f3f-9622-6e95878a8e1f tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d03a35e0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:52.223923 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-3c300c7c-2607-4f3f-9622-6e95878a8e1f tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 200 len: 345 microversion: 2.1 time: 0.061156 Jul 28 09:31:52.224492 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 543/1028] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:31:52 2021] GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:52.226157 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:52.234589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-f35afc61-f885-4af8-a5a0-bf23a5d61b22 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1451 microversion: 2.1 time: 0.150098 Jul 28 09:31:52.235224 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 486/1029] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:52 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:52.774428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-c8a3c953-2105-4901-ba30-c400ade4024c req-001045d4-d308-4f7c-ab26-3945a814e770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "032593b8-197f-4f27-a1af-b2388f64a7d3", "name": "network-vif-deleted", "tag": "018f498b-3f12-45f3-8d86-45656942df90"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:52.776395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:31:52.776395 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:31:52.784978 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c8a3c953-2105-4901-ba30-c400ade4024c req-001045d4-d308-4f7c-ab26-3945a814e770 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:52.785418 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c8a3c953-2105-4901-ba30-c400ade4024c req-001045d4-d308-4f7c-ab26-3945a814e770 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:52.797108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-c8a3c953-2105-4901-ba30-c400ade4024c req-001045d4-d308-4f7c-ab26-3945a814e770 service nova] Creating event network-vif-deleted:018f498b-3f12-45f3-8d86-45656942df90 for instance 032593b8-197f-4f27-a1af-b2388f64a7d3 on hv-cinder-80266 Jul 28 09:31:52.801851 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-c8a3c953-2105-4901-ba30-c400ade4024c req-001045d4-d308-4f7c-ab26-3945a814e770 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031116 Jul 28 09:31:52.802434 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 544/1030] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:31:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:53.235876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-360b6a6d-7762-4955-a529-df7597c0ef06 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d04f5430>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:53.252175 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:53.252919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:53.258888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:53.259342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:53.260144 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:53.260586 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:53.287374 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-360b6a6d-7762-4955-a529-df7597c0ef06 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 200 len: 346 microversion: 2.1 time: 0.055119 Jul 28 09:31:53.288315 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 487/1031] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:31:53 2021] GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:53.292587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:53.293040 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:53.293493 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.objects.instance [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lazy-loading 'fault' on Instance uuid 032593b8-197f-4f27-a1af-b2388f64a7d3 {{(pid=107293) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:31:53.299363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e363295a-027c-499c-ac59-dc4c0f357daf tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Action: 'create', calling method: .version_select at 0x7f16d04e88b0>, body: {"snapshot": {"volume_id": "e4d764b0-a0c7-4a16-a294-262a07f2a271", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1235027410"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:31:53.337581 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4a864435ca04f7189db015e7823ab88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0bed69fc98347318765653ba412b638', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:53.346064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-60b0b244-a5a8-4b30-9ba0-1842d0b80477 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 200 len: 1225 microversion: 2.1 time: 0.097704 Jul 28 09:31:53.346737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 545/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:53 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:31:53.442613 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e363295a-027c-499c-ac59-dc4c0f357daf tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.146858 Jul 28 09:31:53.443283 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 488/1033] 10.222.0.23 () {60 vars in 1162 bytes} [Wed Jul 28 09:31:53 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:53.452975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-a2649307-070b-4599-ac22-98b697b474a7 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0326940>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:53.486876 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-a2649307-070b-4599-ac22-98b697b474a7 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 200 len: 287 microversion: 2.1 time: 0.037310 Jul 28 09:31:53.492056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 546/1034] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:53 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:31:53.498794 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2f83981d-0102-4195-a159-c8f3908c960d tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d04451f0>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:53.530070 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2f83981d-0102-4195-a159-c8f3908c960d tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036599 Jul 28 09:31:53.530642 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 489/1035] 10.222.0.23 () {58 vars in 1140 bytes} [Wed Jul 28 09:31:53 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:53.540112 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-8fb6ebe8-950c-4971-a36e-a210448f051b tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d033fd30>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:53.570474 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-8fb6ebe8-950c-4971-a36e-a210448f051b tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 200 len: 287 microversion: 2.1 time: 0.033843 Jul 28 09:31:53.571035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 547/1036] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:53 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:54.363855 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:54.364467 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] [instance: 032593b8-197f-4f27-a1af-b2388f64a7d3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:54.370324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:54.370760 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:54.371511 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:54.371965 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:54.385595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] HTTP exception thrown: Instance 032593b8-197f-4f27-a1af-b2388f64a7d3 could not be found. Jul 28 09:31:54.386166 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Returning 404 to user: Instance 032593b8-197f-4f27-a1af-b2388f64a7d3 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:54.386970 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-661a946d-2ba6-4707-ad95-81698f986d12 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3" status: 404 len: 111 microversion: 2.1 time: 0.027338 Jul 28 09:31:54.387474 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 490/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:31:54 2021] GET /compute/v2.1/servers/032593b8-197f-4f27-a1af-b2388f64a7d3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:54.539699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-00942e91-af85-4060-acb4-e587b7f7b4f8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] Calling method '.version_select at 0x7f16d035eee0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:54.558702 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-00942e91-af85-4060-acb4-e587b7f7b4f8 tempest-TestShelveInstance-1664583517 tempest-TestShelveInstance-1664583517-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1580493964" status: 202 len: 0 microversion: 2.1 time: 0.022623 Jul 28 09:31:54.559272 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 548/1038] 10.222.0.23 () {58 vars in 1254 bytes} [Wed Jul 28 09:31:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1580493964 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:54.582552 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5998413c-b481-4d6b-93c7-10d6d1358cea tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0457310>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:54.613501 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5998413c-b481-4d6b-93c7-10d6d1358cea tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 200 len: 287 microversion: 2.1 time: 0.034537 Jul 28 09:31:54.614898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 491/1039] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:54 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:55.627171 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-79390eab-2d51-4753-af80-1a8e2ff09a8e tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d02b7550>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:55.656164 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-79390eab-2d51-4753-af80-1a8e2ff09a8e tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 200 len: 287 microversion: 2.1 time: 0.032681 Jul 28 09:31:55.656727 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 549/1040] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:55 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:56.672596 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4a239c85-6210-4736-ad8d-9c861bedb599 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d056ca60>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:56.726453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4a239c85-6210-4736-ad8d-9c861bedb599 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 200 len: 288 microversion: 2.1 time: 0.061969 Jul 28 09:31:56.729649 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 492/1041] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:56 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 288 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:56.739463 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5fe9b5db-cf9e-4eb7-a541-023292833b71 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0326040>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:56.802202 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5fe9b5db-cf9e-4eb7-a541-023292833b71 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 202 len: 0 microversion: 2.1 time: 0.066190 Jul 28 09:31:56.802772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 550/1042] 10.222.0.23 () {58 vars in 1254 bytes} [Wed Jul 28 09:31:56 2021] DELETE /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:56.810739 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0f9c7cd0-e40b-4fb7-adf1-727094d21916 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0445ee0>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:56.846959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0f9c7cd0-e40b-4fb7-adf1-727094d21916 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 200 len: 287 microversion: 2.1 time: 0.038369 Jul 28 09:31:56.846959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 493/1043] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:56 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:31:57.860196 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-20c373a8-eb05-4a28-b989-245136b927cd tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0326af0>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:57.886699 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-20c373a8-eb05-4a28-b989-245136b927cd tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] HTTP exception thrown: Snapshot 253b1919-39b2-4818-b1a3-a3422d52b8e2 could not be found. Jul 28 09:31:57.887299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-20c373a8-eb05-4a28-b989-245136b927cd tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Returning 404 to user: Snapshot 253b1919-39b2-4818-b1a3-a3422d52b8e2 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:57.888199 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-20c373a8-eb05-4a28-b989-245136b927cd tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2" status: 404 len: 111 microversion: 2.1 time: 0.034702 Jul 28 09:31:57.888737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 551/1044] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Jul 28 09:31:57 2021] GET /compute/v2.1/os-snapshots/253b1919-39b2-4818-b1a3-a3422d52b8e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:57.896834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-be731ac8-d500-4058-b0bc-ecb85a9ef1b5 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0499280>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:57.956683 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-be731ac8-d500-4058-b0bc-ecb85a9ef1b5 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 202 len: 0 microversion: 2.1 time: 0.063501 Jul 28 09:31:57.957570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 494/1045] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Jul 28 09:31:57 2021] DELETE /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:31:57.966740 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-97d41372-361c-4c7e-81d8-46752be0b94e tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0f43b80>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:58.022163 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-97d41372-361c-4c7e-81d8-46752be0b94e tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 200 len: 345 microversion: 2.1 time: 0.060100 Jul 28 09:31:58.022770 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 552/1046] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:31:57 2021] GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:31:58.583964 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:58.584582 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:58.590424 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:58.591486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:58.592376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:58.592806 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:58.617682 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:31:58.696800 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5606334b-2835-4b19-aa56-94bb18b881d8 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 204 len: 0 microversion: 2.20 time: 0.116103 Jul 28 09:31:58.697439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 495/1047] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Jul 28 09:31:58 2021] DELETE /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:31:58.706085 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:58.706916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:58.714534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:58.714979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:58.716191 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:58.716740 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:58.847306 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:58.855121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:58.856847 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:31:58.857892 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e3a9bd4c-3be5-4af7-aee5-ec57e743ce64 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.155417 Jul 28 09:31:58.858432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 553/1048] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:58 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 09:31:59.034985 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0e9ae6a4-1aaa-4368-be93-3c45190ea98a tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d04f5430>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:59.064196 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-0e9ae6a4-1aaa-4368-be93-3c45190ea98a tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] HTTP exception thrown: Volume e4d764b0-a0c7-4a16-a294-262a07f2a271 could not be found. Jul 28 09:31:59.065054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0e9ae6a4-1aaa-4368-be93-3c45190ea98a tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Returning 404 to user: Volume e4d764b0-a0c7-4a16-a294-262a07f2a271 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:59.066067 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0e9ae6a4-1aaa-4368-be93-3c45190ea98a tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 404 len: 109 microversion: 2.1 time: 0.035195 Jul 28 09:31:59.066604 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 496/1049] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:31:59 2021] GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:59.080958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-904d9297-e073-4f46-bdd5-24ed27a16c32 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d035ea60>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:59.109370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-904d9297-e073-4f46-bdd5-24ed27a16c32 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] HTTP exception thrown: Volume e4d764b0-a0c7-4a16-a294-262a07f2a271 could not be found. Jul 28 09:31:59.109829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-904d9297-e073-4f46-bdd5-24ed27a16c32 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Returning 404 to user: Volume e4d764b0-a0c7-4a16-a294-262a07f2a271 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:59.110653 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-904d9297-e073-4f46-bdd5-24ed27a16c32 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 404 len: 109 microversion: 2.1 time: 0.033976 Jul 28 09:31:59.114475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 554/1050] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Jul 28 09:31:59 2021] DELETE /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 09:31:59.119323 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8e8d39b1-1bda-47e8-926b-cc6fcf6ee1d5 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Calling method '.version_select at 0x7f16d0457160>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:59.148815 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-8e8d39b1-1bda-47e8-926b-cc6fcf6ee1d5 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] HTTP exception thrown: Volume e4d764b0-a0c7-4a16-a294-262a07f2a271 could not be found. Jul 28 09:31:59.149570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8e8d39b1-1bda-47e8-926b-cc6fcf6ee1d5 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] Returning 404 to user: Volume e4d764b0-a0c7-4a16-a294-262a07f2a271 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:31:59.150406 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8e8d39b1-1bda-47e8-926b-cc6fcf6ee1d5 tempest-VolumesSnapshotsTestJSON-1467272808 tempest-VolumesSnapshotsTestJSON-1467272808-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271" status: 404 len: 109 microversion: 2.1 time: 0.035027 Jul 28 09:31:59.151523 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 497/1051] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Jul 28 09:31:59 2021] GET /compute/v2.1/os-volumes/e4d764b0-a0c7-4a16-a294-262a07f2a271 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:31:59.876577 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:31:59.876948 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:31:59.889354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:59.889587 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:31:59.892789 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:31:59.893224 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:00.064034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:00.072241 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:00.077933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:00.080862 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f30c92a8-e213-4263-a445-5e9d970af073 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1722 microversion: 2.20 time: 0.209001 Jul 28 09:32:00.082585 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 555/1052] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:31:59 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:32:01.100109 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:01.103444 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:01.117307 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:01.119515 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:01.124615 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:01.125650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:01.250076 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-55e367af-ddb0-4746-a654-af8698e9eaa2 req-ec5a711e-566a-4d3d-a504-4f935b97a930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96654e-95dd-48bb-adf3-91e5eed7b520", "name": "network-vif-deleted", "tag": "9b6651ac-a2a9-45c2-85c4-d67031aa172a"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:32:01.253496 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:32:01.253496 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:32:01.277527 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-55e367af-ddb0-4746-a654-af8698e9eaa2 req-ec5a711e-566a-4d3d-a504-4f935b97a930 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:01.278014 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-55e367af-ddb0-4746-a654-af8698e9eaa2 req-ec5a711e-566a-4d3d-a504-4f935b97a930 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:01.304402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-55e367af-ddb0-4746-a654-af8698e9eaa2 req-ec5a711e-566a-4d3d-a504-4f935b97a930 service nova] Creating event network-vif-deleted:9b6651ac-a2a9-45c2-85c4-d67031aa172a for instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 on hv-cinder-80266 Jul 28 09:32:01.315933 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-55e367af-ddb0-4746-a654-af8698e9eaa2 req-ec5a711e-566a-4d3d-a504-4f935b97a930 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090104 Jul 28 09:32:01.319451 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 556/1053] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:32:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 28 09:32:01.328160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:01.347652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:01.358672 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ccc60eb94ea47cc9dfa5f5240c16263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8340ca8a0bb47c3871a9e4d939e9a44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:01.361744 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8b97ded9-20fd-4ebd-bdaf-bff7ce260b77 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 200 len: 1654 microversion: 2.20 time: 0.265903 Jul 28 09:32:01.371089 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 498/1054] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:32:01 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 1654 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 09:32:02.391279 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:02.392016 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:02.399093 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:02.399816 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:02.400755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:02.401753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:02.418471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] HTTP exception thrown: Instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 could not be found. Jul 28 09:32:02.420071 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Returning 404 to user: Instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:32:02.421429 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5d2eb449-419f-46ee-a68c-36604dc19f2b tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 404 len: 111 microversion: 2.20 time: 0.036675 Jul 28 09:32:02.422740 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 557/1055] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Jul 28 09:32:02 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 09:32:02.430871 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-29156ad9-8b6f-48d9-81b8-20f75f0a0548 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '.version_select at 0x7f16d0457430>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:02.451448 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-29156ad9-8b6f-48d9-81b8-20f75f0a0548 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692697247" status: 204 len: 0 microversion: 2.20 time: 0.024187 Jul 28 09:32:02.456035 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 499/1056] 10.222.0.23 () {60 vars in 1262 bytes} [Wed Jul 28 09:32:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692697247 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 09:32:04.546166 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:04.546725 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:04.552543 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:04.553075 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:04.553902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:04.554396 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:04.567520 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] HTTP exception thrown: Instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 could not be found. Jul 28 09:32:04.568120 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Returning 404 to user: Instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:32:04.568966 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9285586e-93b2-4367-a25a-0617064cf35f tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 404 len: 111 microversion: 2.1 time: 0.026672 Jul 28 09:32:04.569482 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 558/1057] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:32:04 2021] DELETE /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:32:04.577757 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:04.578453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 5a96654e-95dd-48bb-adf3-91e5eed7b520] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:04.584078 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:04.584522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:04.585273 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:04.585986 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:04.601168 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] HTTP exception thrown: Instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 could not be found. Jul 28 09:32:04.601898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Returning 404 to user: Instance 5a96654e-95dd-48bb-adf3-91e5eed7b520 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:32:04.602724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-5e41b260-167c-4666-8ee2-58126af3dc79 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520" status: 404 len: 111 microversion: 2.1 time: 0.029222 Jul 28 09:32:04.603329 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 500/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:04 2021] GET /compute/v2.1/servers/5a96654e-95dd-48bb-adf3-91e5eed7b520 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:32:05.738237 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:05.738810 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:05.744502 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:05.745048 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:05.745772 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:05.746252 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:05.759639 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] HTTP exception thrown: Instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 could not be found. Jul 28 09:32:05.760222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Returning 404 to user: Instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:32:05.761041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0900e808-f6bd-4727-9f3e-4af947564932 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 404 len: 111 microversion: 2.1 time: 0.026502 Jul 28 09:32:05.761565 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 559/1059] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:32:05 2021] DELETE /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:32:05.769933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:05.770544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] [instance: 1770556b-7187-418c-9c5e-6f6652a8f4c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:05.776533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:05.776976 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:05.777732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:05.778160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:05.792189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] HTTP exception thrown: Instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 could not be found. Jul 28 09:32:05.792761 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] Returning 404 to user: Instance 1770556b-7187-418c-9c5e-6f6652a8f4c3 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:32:05.793564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ef5fc9a4-86a5-4280-bad9-f9978849a242 tempest-AttachVolumeShelveTestJSON-1908779393 tempest-AttachVolumeShelveTestJSON-1908779393-project] 10.222.0.23 "GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3" status: 404 len: 111 microversion: 2.1 time: 0.027375 Jul 28 09:32:05.794069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 501/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:05 2021] GET /compute/v2.1/servers/1770556b-7187-418c-9c5e-6f6652a8f4c3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:32:41.062861 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1706444130", "imageRef": "77fb54f3-654f-4ec2-8b5f-cd679746a3e5", "flavorRef": "452"}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:32:41.116855 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] validate_networks() for None {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:32:41.382958 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:32:41.383383 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:32:41.383904 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:32:41.384320 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:32:41.384729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:32:41.395245 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:41.395742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:41.396550 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:41.396988 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:41.415479 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Getting quotas for project 1f7d9984c3e24e34975042615becf1d1. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:32:41.421815 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Getting quotas for user d0a7938270524f42938aef2ca5d74360 and project 1f7d9984c3e24e34975042615becf1d1. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:32:41.432763 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:32:41.435059 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='77fb54f3-654f-4ec2-8b5f-cd679746a3e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:32:41.482065 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-28089692-b3cf-427b-bd8e-9f8728e26da2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423404 Jul 28 09:32:41.482732 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 560/1061] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:32:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:32:41.492701 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-8f151c3c-5e9c-4401-9932-0578cef6c5c2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:41.493314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-8f151c3c-5e9c-4401-9932-0578cef6c5c2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:41.545237 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-8f151c3c-5e9c-4401-9932-0578cef6c5c2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:41.552579 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-8f151c3c-5e9c-4401-9932-0578cef6c5c2 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1215 microversion: 2.1 time: 0.063714 Jul 28 09:32:41.553174 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 502/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:41 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:42.569812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-9724a2af-e6a2-42b8-87e2-415722ca6b78 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:42.570529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-9724a2af-e6a2-42b8-87e2-415722ca6b78 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:42.620938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-9724a2af-e6a2-42b8-87e2-415722ca6b78 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:42.627311 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-9724a2af-e6a2-42b8-87e2-415722ca6b78 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1215 microversion: 2.1 time: 0.061270 Jul 28 09:32:42.627910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 561/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:42 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1215 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:43.643730 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3d87bbed-38b4-47fb-8666-52261a039e35 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:43.644619 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3d87bbed-38b4-47fb-8666-52261a039e35 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:43.696047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3d87bbed-38b4-47fb-8666-52261a039e35 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:43.703969 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3d87bbed-38b4-47fb-8666-52261a039e35 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1215 microversion: 2.1 time: 0.063846 Jul 28 09:32:43.704781 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 503/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:43 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:44.720950 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-dc3b6a10-e00f-4025-8df7-864befe83444 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:44.721559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-dc3b6a10-e00f-4025-8df7-864befe83444 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:44.772184 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-dc3b6a10-e00f-4025-8df7-864befe83444 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:44.780619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-dc3b6a10-e00f-4025-8df7-864befe83444 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1215 microversion: 2.1 time: 0.063575 Jul 28 09:32:44.781513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 562/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:44 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:45.799147 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:45.799832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:45.805585 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:45.806030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:45.806795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:45.807229 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:45.865311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:45.872473 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a43920fc-23e8-4b3b-a049-5f171d348633 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1219 microversion: 2.1 time: 0.078155 Jul 28 09:32:45.873025 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 504/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:45 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:46.889573 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:46.890178 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:46.895986 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:46.896588 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:46.898067 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:46.898698 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:46.968881 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:46.976100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-86683a8e-d804-4c3c-93d0-65d1cee325f7 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1273 microversion: 2.1 time: 0.090396 Jul 28 09:32:46.976669 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 563/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:46 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:47.996409 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:47.997876 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:48.005370 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:48.005826 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:48.006621 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:48.007059 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:48.202660 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:48.211662 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-1dd96a84-da7a-495a-b54d-caf7580860b9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1315 microversion: 2.1 time: 0.222421 Jul 28 09:32:48.212233 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 505/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:47 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:48.254561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-c41c34c9-41e4-4d1b-a2d6-0a3896798b90 req-7bdd1959-c2d1-4f5f-9188-46cd3420b0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ce90ec-0e73-4461-ae44-158dbe4bdaca", "tag": "984ed6da-a728-46a5-95be-97e5ef6a4685"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:32:48.256370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:32:48.256370 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:32:48.267926 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c41c34c9-41e4-4d1b-a2d6-0a3896798b90 req-7bdd1959-c2d1-4f5f-9188-46cd3420b0fe service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:48.268589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-c41c34c9-41e4-4d1b-a2d6-0a3896798b90 req-7bdd1959-c2d1-4f5f-9188-46cd3420b0fe service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:48.281994 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-c41c34c9-41e4-4d1b-a2d6-0a3896798b90 req-7bdd1959-c2d1-4f5f-9188-46cd3420b0fe service nova] Creating event network-changed:984ed6da-a728-46a5-95be-97e5ef6a4685 for instance c3ce90ec-0e73-4461-ae44-158dbe4bdaca on hv-cinder-80266 Jul 28 09:32:48.287141 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-c41c34c9-41e4-4d1b-a2d6-0a3896798b90 req-7bdd1959-c2d1-4f5f-9188-46cd3420b0fe service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039287 Jul 28 09:32:48.287947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 564/1069] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:32:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:32:49.228993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:49.229525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:49.236014 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:49.236454 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:49.237215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:49.237650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:49.361493 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:49.368735 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c20fba62-7011-4dc2-a41a-a6a45a4abb77 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1315 microversion: 2.1 time: 0.143543 Jul 28 09:32:49.369326 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 506/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:49 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:50.386540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:50.387249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:50.393857 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:50.394308 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:50.395107 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:50.395545 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:50.517938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:50.525077 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-805de0f8-bea0-475e-ae99-8a785a0c8e8d tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1315 microversion: 2.1 time: 0.142759 Jul 28 09:32:50.525901 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 565/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:50 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:51.541215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:51.541832 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:51.547834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:51.548277 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:51.549069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:51.549500 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:51.640149 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:32:51.640455 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:32:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca (ip 10.222.0.23) !!! Jul 28 09:32:51.679384 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:51.687528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ca33f823-87a5-45a6-b4ba-92358e5b1058 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1315 microversion: 2.1 time: 0.150244 Jul 28 09:32:51.688126 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 507/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:51 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:52.704494 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:52.705098 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:52.711334 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:52.711813 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:52.712576 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:52.713033 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:52.833916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:52.841136 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-1d546b9a-8514-42b4-a509-c965eb315065 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1315 microversion: 2.1 time: 0.141010 Jul 28 09:32:52.841702 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 566/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:52 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:53.446645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-74e34267-41b0-41fd-be20-2fdcefc0692c req-181bc423-0047-4625-96e4-ccef8ddf919d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ce90ec-0e73-4461-ae44-158dbe4bdaca", "name": "network-vif-plugged", "status": "completed", "tag": "984ed6da-a728-46a5-95be-97e5ef6a4685"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:32:53.448231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:32:53.448231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:32:53.455732 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-74e34267-41b0-41fd-be20-2fdcefc0692c req-181bc423-0047-4625-96e4-ccef8ddf919d service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:53.456174 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-74e34267-41b0-41fd-be20-2fdcefc0692c req-181bc423-0047-4625-96e4-ccef8ddf919d service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:53.469541 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-74e34267-41b0-41fd-be20-2fdcefc0692c req-181bc423-0047-4625-96e4-ccef8ddf919d service nova] Creating event network-vif-plugged:984ed6da-a728-46a5-95be-97e5ef6a4685 for instance c3ce90ec-0e73-4461-ae44-158dbe4bdaca on hv-cinder-80266 Jul 28 09:32:53.474450 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-74e34267-41b0-41fd-be20-2fdcefc0692c req-181bc423-0047-4625-96e4-ccef8ddf919d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031503 Jul 28 09:32:53.475031 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 508/1074] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:32:53.857700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:53.858266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:53.864210 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:53.864663 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:53.865437 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:53.865871 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:53.993232 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:54.000865 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-52f0eaa5-4a9c-4245-ba97-51deb67c2619 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1315 microversion: 2.1 time: 0.147019 Jul 28 09:32:54.001426 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 567/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:53 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:55.018267 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:55.018962 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:55.024914 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:55.025357 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:55.026363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:55.026791 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:55.146225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:55.153620 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a054d418-105c-4685-82e1-5540213f9ebb tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1464 microversion: 2.1 time: 0.139991 Jul 28 09:32:55.154181 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 509/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:55 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:55.189944 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:55.190431 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:55.196264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:55.196696 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:55.197460 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:55.197888 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:55.222860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Going to try to terminate instance {{(pid=107293) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:32:55.294848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4a3dbfec-93d8-4d37-a50e-344788aa0345 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 204 len: 0 microversion: 2.1 time: 0.108880 Jul 28 09:32:55.295432 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 568/1077] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:32:55 2021] DELETE /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:32:55.303945 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:55.304553 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:55.310262 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:55.310702 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:55.311535 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:55.312044 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:55.432485 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:55.440414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-73a57560-09ed-42f9-b74d-0717172e0fb9 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1470 microversion: 2.1 time: 0.140079 Jul 28 09:32:55.440984 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 510/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:55 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1470 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:56.458913 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:56.459620 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:56.465549 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:56.466037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:56.466812 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:56.467236 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:56.591894 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0a7938270524f42938aef2ca5d74360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f7d9984c3e24e34975042615becf1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:32:56.599905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-542f4213-a1d1-47e1-8c3e-139cfac668cc tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 200 len: 1470 microversion: 2.1 time: 0.144999 Jul 28 09:32:56.600464 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 569/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:56 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 1470 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:32:57.074485 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-f255d4c9-802f-4523-86a7-eeb759216cbc req-274ca16e-dd15-4e7c-93f3-cade62326564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ce90ec-0e73-4461-ae44-158dbe4bdaca", "name": "network-vif-deleted", "tag": "984ed6da-a728-46a5-95be-97e5ef6a4685"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:32:57.076019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:32:57.076019 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:32:57.084054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-f255d4c9-802f-4523-86a7-eeb759216cbc req-274ca16e-dd15-4e7c-93f3-cade62326564 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:57.084498 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-f255d4c9-802f-4523-86a7-eeb759216cbc req-274ca16e-dd15-4e7c-93f3-cade62326564 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:57.099311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-f255d4c9-802f-4523-86a7-eeb759216cbc req-274ca16e-dd15-4e7c-93f3-cade62326564 service nova] Creating event network-vif-deleted:984ed6da-a728-46a5-95be-97e5ef6a4685 for instance c3ce90ec-0e73-4461-ae44-158dbe4bdaca on hv-cinder-80266 Jul 28 09:32:57.104063 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-f255d4c9-802f-4523-86a7-eeb759216cbc req-274ca16e-dd15-4e7c-93f3-cade62326564 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033140 Jul 28 09:32:57.104670 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 511/1080] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:32:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:32:57.617044 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:32:57.617651 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] [instance: c3ce90ec-0e73-4461-ae44-158dbe4bdaca] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:32:57.624119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:57.624907 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:57.625709 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:32:57.626146 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:32:57.639932 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] HTTP exception thrown: Instance c3ce90ec-0e73-4461-ae44-158dbe4bdaca could not be found. Jul 28 09:32:57.640778 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] Returning 404 to user: Instance c3ce90ec-0e73-4461-ae44-158dbe4bdaca could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:32:57.641598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b09cc10c-10ed-45ac-a43b-efe54acef690 tempest-VolumesNegativeTest-1273115319 tempest-VolumesNegativeTest-1273115319-project] 10.222.0.23 "GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca" status: 404 len: 111 microversion: 2.1 time: 0.028398 Jul 28 09:32:57.642109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 570/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:32:57 2021] GET /compute/v2.1/servers/c3ce90ec-0e73-4461-ae44-158dbe4bdaca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:33:10.937717 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0dbabeba-49d1-4565-80f4-2b39dfefb7ee tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Action: 'create', calling method: .version_select at 0x7f16d0457310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1180029500"}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:33:10.956606 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-0dbabeba-49d1-4565-80f4-2b39dfefb7ee tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:33:10.960289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-0dbabeba-49d1-4565-80f4-2b39dfefb7ee tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for user be335187506143e6a93fed6aa00005e0 and project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:33:11.531706 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-0dbabeba-49d1-4565-80f4-2b39dfefb7ee tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:33:11.535681 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-0dbabeba-49d1-4565-80f4-2b39dfefb7ee tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for user be335187506143e6a93fed6aa00005e0 and project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'key_pairs'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:33:11.549480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0dbabeba-49d1-4565-80f4-2b39dfefb7ee tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.798444 Jul 28 09:33:11.550093 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 512/1082] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Jul 28 09:33:10 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:27.820532 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90e9f45c-2cde-49e9-a278-1ed805d55ba3] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 09:33:27.823900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1373466933", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1180029500", "security_groups": [{"name": "tempest-secgroup-smoke-1050948725"}], "block_device_mapping_v2": [{"uuid": "9b4ae89d-1cdd-4138-be3c-7e1866a7b53c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1fc2852d-286a-4480-bedd-ff38c463ba78"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:33:27.925056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] validate_networks() for [('1fc2852d-286a-4480-bedd-ff38c463ba78', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:33:28.566034 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:33:28.566452 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:33:28.566919 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:33:28.567354 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:33:28.567807 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:33:28.576206 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:28.576646 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:28.578121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:28.578636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:28.594364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:33:28.598176 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for user be335187506143e6a93fed6aa00005e0 and project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:33:28.659064 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:33:28.661249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b4ae89d-1cdd-4138-be3c-7e1866a7b53c',volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:33:28.783181 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-2ed48186-079e-44d4-9403-23cbcae612d6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.963985 Jul 28 09:33:28.783849 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 571/1083] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:33:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:33:28.793589 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-00e56da2-3d0b-46ce-8d4c-ba826d4a51af tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:28.794319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-00e56da2-3d0b-46ce-8d4c-ba826d4a51af tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:28.848274 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-00e56da2-3d0b-46ce-8d4c-ba826d4a51af tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:28.854782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-00e56da2-3d0b-46ce-8d4c-ba826d4a51af tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1095 microversion: 2.1 time: 0.065008 Jul 28 09:33:28.855338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 513/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:28 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:29.882614 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:29.883341 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:29.892089 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] [90e9f45c-2cde-49e9-a278-1ed805d55ba3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43338. Jul 28 09:33:29.898954 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:29.899400 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:29.900458 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:29.900894 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:29.986490 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:29.994428 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b6b13619-3df0-47c5-97d3-262dc183189e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1211 microversion: 2.1 time: 0.126710 Jul 28 09:33:29.995287 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 572/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:29 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:31.012281 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:31.012899 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:31.019246 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:31.019782 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:31.020559 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:31.020989 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:31.213215 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:31.222243 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-39800d42-9fe1-4375-8fba-b967acc88dce tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.213990 Jul 28 09:33:31.222959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 514/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:31 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:31.278779 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-490c8c83-5f73-4846-b1db-03004b9b8d38 req-89c625ee-3c69-4773-9af5-42500f284801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9497a09-01fe-443f-9026-79e18807af68", "tag": "88a47cb2-374c-48a7-a6b4-a1b921237b75"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:33:31.280379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:33:31.280379 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:33:31.287647 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-490c8c83-5f73-4846-b1db-03004b9b8d38 req-89c625ee-3c69-4773-9af5-42500f284801 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:31.288100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-490c8c83-5f73-4846-b1db-03004b9b8d38 req-89c625ee-3c69-4773-9af5-42500f284801 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:31.300500 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-490c8c83-5f73-4846-b1db-03004b9b8d38 req-89c625ee-3c69-4773-9af5-42500f284801 service nova] Creating event network-changed:88a47cb2-374c-48a7-a6b4-a1b921237b75 for instance f9497a09-01fe-443f-9026-79e18807af68 on hv-cinder-80266 Jul 28 09:33:31.311281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-490c8c83-5f73-4846-b1db-03004b9b8d38 req-89c625ee-3c69-4773-9af5-42500f284801 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036226 Jul 28 09:33:31.312122 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 573/1087] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:33:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:33:32.238868 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:32.239493 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:32.245324 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:32.245773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:32.246538 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:32.246969 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:32.369296 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:32.378084 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a116ae45-dee8-4a2f-98d7-771c0e55cecb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.142843 Jul 28 09:33:32.378652 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 515/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:32 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:33.394739 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:33.395466 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:33.401834 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:33.402280 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:33.403041 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:33.403469 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:33.527246 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:33.535105 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c48ff2ee-60f3-4e4d-a8b9-aa1d4cd38407 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.144375 Jul 28 09:33:33.535675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 574/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:33 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:34.551489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:34.552032 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:34.557888 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:34.558332 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:34.559092 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:34.559522 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:34.682768 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:34.690592 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d4766b5d-054e-43c8-9378-408b090930dd tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.142826 Jul 28 09:33:34.691161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 516/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:34 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:35.707345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:35.708005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:35.713823 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:35.714266 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:35.715017 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:35.715444 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:35.841698 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:35.851283 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-e7bfd7e1-ec48-4640-8031-0439cfe1e4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.147613 Jul 28 09:33:35.851873 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 575/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:35 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:36.867645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:36.868289 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:36.874231 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:36.874679 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:36.875435 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:36.875961 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:36.995458 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:37.003208 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a25af07c-2bc2-4cf2-a1f8-76696f309e7c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.139277 Jul 28 09:33:37.003793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 517/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:36 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:38.019710 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:38.020361 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:38.026519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:38.026960 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:38.027737 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:38.028166 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:38.152693 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:38.160217 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-b00f124e-aa38-4a9a-8f60-d7808fa7f960 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.144272 Jul 28 09:33:38.160774 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 576/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:38 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:39.177083 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:39.177710 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:39.183567 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:39.184036 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:39.184789 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:39.185217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:39.303146 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:39.310241 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9a803f46-6a14-490b-b3f9-edd37665d4cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.136839 Jul 28 09:33:39.310802 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 518/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:39 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:40.326526 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:40.327368 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:40.333300 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:40.333745 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:40.334513 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:40.334945 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:40.451890 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:40.459159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7088183c-b72d-4fc4-beb6-41cf4693eb52 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.136261 Jul 28 09:33:40.459842 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 577/1095] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:40 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:41.475702 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:41.476319 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:41.482143 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:41.482595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:41.483382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:41.483842 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:41.608864 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:41.616425 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d95a8cee-f2f9-4f8c-9c24-77ed6be80b4d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.144456 Jul 28 09:33:41.617173 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 519/1096] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:41 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:41.685845 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-7eedfedf-7f74-4af0-bb25-8672a5cc7d5d req-c8804ebe-df9e-43ae-9eca-9089c2ac56ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9497a09-01fe-443f-9026-79e18807af68", "name": "network-vif-plugged", "status": "completed", "tag": "88a47cb2-374c-48a7-a6b4-a1b921237b75"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:33:41.688021 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:33:41.688021 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:33:41.695228 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-7eedfedf-7f74-4af0-bb25-8672a5cc7d5d req-c8804ebe-df9e-43ae-9eca-9089c2ac56ef service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:41.695712 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-7eedfedf-7f74-4af0-bb25-8672a5cc7d5d req-c8804ebe-df9e-43ae-9eca-9089c2ac56ef service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:41.708167 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-7eedfedf-7f74-4af0-bb25-8672a5cc7d5d req-c8804ebe-df9e-43ae-9eca-9089c2ac56ef service nova] Creating event network-vif-plugged:88a47cb2-374c-48a7-a6b4-a1b921237b75 for instance f9497a09-01fe-443f-9026-79e18807af68 on hv-cinder-80266 Jul 28 09:33:41.718154 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-7eedfedf-7f74-4af0-bb25-8672a5cc7d5d req-c8804ebe-df9e-43ae-9eca-9089c2ac56ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035945 Jul 28 09:33:41.719123 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 578/1097] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:33:42.633698 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:42.634382 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:42.640763 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:42.641207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:42.641969 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:42.642399 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:42.763807 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:42.772258 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-aeb9276f-a44c-47c3-b651-173f174893a4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1267 microversion: 2.1 time: 0.142386 Jul 28 09:33:42.772816 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 520/1098] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:42 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:43.790047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:43.790752 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:43.797561 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:43.798006 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:43.798780 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:43.799219 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:43.923457 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:43.930716 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-076f407d-3643-4082-a03e-f37cd1ce58c8 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1455 microversion: 2.1 time: 0.144749 Jul 28 09:33:43.931282 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 579/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:43 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:43.946647 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:33:43.947828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:33:43.954137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:43.954575 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:43.955347 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:43.955805 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:44.080966 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:33:44.088178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-26e98ce5-8c1b-461a-90b2-9faaee30bc2e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1455 microversion: 2.1 time: 0.145069 Jul 28 09:33:44.088745 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 521/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:33:43 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:33:45.716380 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-090739cf-db98-4e11-99f9-a96e776d3fb7 req-fcc19754-95aa-455b-9055-0598c457544f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9497a09-01fe-443f-9026-79e18807af68", "tag": "88a47cb2-374c-48a7-a6b4-a1b921237b75"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:33:45.717900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:33:45.717900 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:33:45.726305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-090739cf-db98-4e11-99f9-a96e776d3fb7 req-fcc19754-95aa-455b-9055-0598c457544f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:33:45.726753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-090739cf-db98-4e11-99f9-a96e776d3fb7 req-fcc19754-95aa-455b-9055-0598c457544f service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:33:45.738388 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-090739cf-db98-4e11-99f9-a96e776d3fb7 req-fcc19754-95aa-455b-9055-0598c457544f service nova] Creating event network-changed:88a47cb2-374c-48a7-a6b4-a1b921237b75 for instance f9497a09-01fe-443f-9026-79e18807af68 on hv-cinder-80266 Jul 28 09:33:45.743124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-090739cf-db98-4e11-99f9-a96e776d3fb7 req-fcc19754-95aa-455b-9055-0598c457544f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031546 Jul 28 09:33:45.743742 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 580/1101] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:34:43.467013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:34:43.467754 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:34:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:35:04.079156 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:35:04.079895 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:35:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:35:40.718006 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d6a213-4f50-4b3a-9710-c704a296fd53] AMQP server on 10.222.0.23:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 09:35:40.721671 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:40.722160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:40.727971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:40.728414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:40.729170 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:40.729595 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:40.753841 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:35:40.826929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-edee48fd-cb04-4a35-b0c0-3f40481604cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 204 len: 0 microversion: 2.1 time: 0.110252 Jul 28 09:35:40.827748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 522/1102] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:35:40 2021] DELETE /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:35:40.834044 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90e9f45c-2cde-49e9-a278-1ed805d55ba3] AMQP server on 10.222.0.23:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 09:35:40.837902 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:40.838598 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:40.845848 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:40.846296 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:40.847062 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:40.847499 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:41.015025 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:41.022314 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5ddc3466-70b1-4523-b356-da40204b20f1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1580 microversion: 2.1 time: 0.190240 Jul 28 09:35:41.022869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 581/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:40 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1580 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:42.040030 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:42.040724 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:42.059985 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:42.060431 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:42.061765 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:42.062206 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:42.067380 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d6a213-4f50-4b3a-9710-c704a296fd53] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43420. Jul 28 09:35:42.238376 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:42.245930 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-e65208db-b6bc-4f70-bbd2-cc07ded1c764 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1580 microversion: 2.1 time: 0.209921 Jul 28 09:35:42.246497 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 523/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:42 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1580 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:43.203998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] [90e9f45c-2cde-49e9-a278-1ed805d55ba3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43428. Jul 28 09:35:43.256119 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-6bcbb44d-044a-4a85-a42a-6e2e43e4ad9c req-f0b9ead0-aad2-4272-a4f2-d08578cd9a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9497a09-01fe-443f-9026-79e18807af68", "name": "network-vif-deleted", "tag": "88a47cb2-374c-48a7-a6b4-a1b921237b75"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:35:43.257607 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:35:43.257607 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:35:43.266234 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-6bcbb44d-044a-4a85-a42a-6e2e43e4ad9c req-f0b9ead0-aad2-4272-a4f2-d08578cd9a59 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:43.266988 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-6bcbb44d-044a-4a85-a42a-6e2e43e4ad9c req-f0b9ead0-aad2-4272-a4f2-d08578cd9a59 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:43.267601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:43.268748 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:43.277415 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:43.277887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:43.278577 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:43.279007 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:43.281056 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-6bcbb44d-044a-4a85-a42a-6e2e43e4ad9c req-f0b9ead0-aad2-4272-a4f2-d08578cd9a59 service nova] Creating event network-vif-deleted:88a47cb2-374c-48a7-a6b4-a1b921237b75 for instance f9497a09-01fe-443f-9026-79e18807af68 on hv-cinder-80266 Jul 28 09:35:43.286664 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-6bcbb44d-044a-4a85-a42a-6e2e43e4ad9c req-f0b9ead0-aad2-4272-a4f2-d08578cd9a59 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103326 Jul 28 09:35:43.287921 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 582/1105] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:35:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:35:43.350814 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:43.358507 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-78373815-c967-421d-b19c-797b901c6440 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 200 len: 1226 microversion: 2.1 time: 0.095492 Jul 28 09:35:43.359082 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 524/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:43 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:35:44.375860 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:44.376559 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:44.382529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:44.382984 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:44.383753 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:44.384181 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:44.397863 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] HTTP exception thrown: Instance f9497a09-01fe-443f-9026-79e18807af68 could not be found. Jul 28 09:35:44.398488 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Returning 404 to user: Instance f9497a09-01fe-443f-9026-79e18807af68 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:35:44.399567 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-fc889373-ce05-48b7-ab5d-c62d5b769371 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 404 len: 111 microversion: 2.1 time: 0.028182 Jul 28 09:35:44.400109 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 583/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:44 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:35:44.444544 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-197867266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1180029500", "security_groups": [{"name": "tempest-secgroup-smoke-1050948725"}], "block_device_mapping_v2": [{"uuid": "9b4ae89d-1cdd-4138-be3c-7e1866a7b53c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1fc2852d-286a-4480-bedd-ff38c463ba78"}]}} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:35:44.544728 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.network.neutron [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] validate_networks() for [('1fc2852d-286a-4480-bedd-ff38c463ba78', None, None, None)] {{(pid=107292) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:35:44.952568 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Flavor limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:35:44.952999 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Image limits 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:35:44.953480 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Flavor pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:35:44.953887 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Image pref 0:0:0 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:35:44.954303 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.virt.hardware [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:35:44.963597 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:44.964049 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:44.964860 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:44.965293 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:44.981744 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:35:44.986366 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.quota [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for user be335187506143e6a93fed6aa00005e0 and project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'ram', 'instances', 'cores'} {{(pid=107292) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:35:45.045718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Going to run 1 instances... {{(pid=107292) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:35:45.047880 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b4ae89d-1cdd-4138-be3c-7e1866a7b53c',volume_size=None,volume_type=None)] {{(pid=107292) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:35:45.166888 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-d6cf19e2-f177-41d6-8e08-2ae4d35dbf21 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725954 Jul 28 09:35:45.167528 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 525/1108] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:35:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:35:45.177336 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d9e6186c-2211-4afa-a0c6-73d24c723806 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:45.177951 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d9e6186c-2211-4afa-a0c6-73d24c723806 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:45.234903 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d9e6186c-2211-4afa-a0c6-73d24c723806 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:45.241443 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d9e6186c-2211-4afa-a0c6-73d24c723806 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1094 microversion: 2.1 time: 0.067811 Jul 28 09:35:45.241985 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 584/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:45 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:46.258018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-3674a6cd-9de9-4870-9ff1-f6a4bcb29e1b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:46.258633 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-3674a6cd-9de9-4870-9ff1-f6a4bcb29e1b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:46.310486 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-3674a6cd-9de9-4870-9ff1-f6a4bcb29e1b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:46.319426 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-3674a6cd-9de9-4870-9ff1-f6a4bcb29e1b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1094 microversion: 2.1 time: 0.065045 Jul 28 09:35:46.320010 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 526/1110] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:46 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:47.336555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-02433324-ecd5-45ed-ab25-1c10a99e0264 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:47.337161 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-02433324-ecd5-45ed-ab25-1c10a99e0264 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:47.388180 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-02433324-ecd5-45ed-ab25-1c10a99e0264 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:47.396121 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-02433324-ecd5-45ed-ab25-1c10a99e0264 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1094 microversion: 2.1 time: 0.063221 Jul 28 09:35:47.396746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 585/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:47 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:48.412630 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-94afead6-848b-455f-aa7d-76a365e3a02b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:48.413235 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-94afead6-848b-455f-aa7d-76a365e3a02b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:48.464383 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-94afead6-848b-455f-aa7d-76a365e3a02b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:48.470946 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-94afead6-848b-455f-aa7d-76a365e3a02b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1094 microversion: 2.1 time: 0.061967 Jul 28 09:35:48.471512 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 527/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:48 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:49.487949 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:49.488578 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:49.494534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:49.494916 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:49.495693 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:49.496133 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:49.554058 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:49.562227 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-d9dbba8d-6004-4bb6-b63c-6c58dd92add5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1144 microversion: 2.1 time: 0.077940 Jul 28 09:35:49.562795 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 586/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:49 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1144 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:50.578385 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:50.579011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:50.585240 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:50.585900 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:50.586877 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:50.587349 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:50.687137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:50.694949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6610a87e-c52b-4e18-b760-ee95567f0cc7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1210 microversion: 2.1 time: 0.120528 Jul 28 09:35:50.695536 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 528/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:50 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:35:51.550804 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-1aeb9e81-d107-4a74-be32-db98b7f4403c req-b1e1e1f5-d212-4b79-bd4a-cf93c3abe2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe9c147-922e-4b88-81b7-5e5fc25c4b33", "tag": "9c2786c4-77fe-4cf5-9aba-f61c414df2fd"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:35:51.554869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:35:51.554869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:35:51.565462 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-1aeb9e81-d107-4a74-be32-db98b7f4403c req-b1e1e1f5-d212-4b79-bd4a-cf93c3abe2ff service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:51.566328 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-1aeb9e81-d107-4a74-be32-db98b7f4403c req-b1e1e1f5-d212-4b79-bd4a-cf93c3abe2ff service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:51.580484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-1aeb9e81-d107-4a74-be32-db98b7f4403c req-b1e1e1f5-d212-4b79-bd4a-cf93c3abe2ff service nova] Creating event network-changed:9c2786c4-77fe-4cf5-9aba-f61c414df2fd for instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 on hv-cinder-80266 Jul 28 09:35:51.585324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-1aeb9e81-d107-4a74-be32-db98b7f4403c req-b1e1e1f5-d212-4b79-bd4a-cf93c3abe2ff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041287 Jul 28 09:35:51.585989 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 587/1115] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:35:51.712373 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:51.712996 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:51.718891 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:51.719363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:51.720160 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:51.720603 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:51.902986 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:51.911090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-eb4d6a81-7bf8-41a5-a8b7-675674b72af2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.202450 Jul 28 09:35:51.911675 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 529/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:51 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:52.929071 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:52.929773 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:52.936364 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:52.937583 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:52.937583 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:52.938005 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:53.062534 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:53.069826 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ed762936-b439-4fbc-9322-72e5ca8a101e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.144812 Jul 28 09:35:53.070389 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 588/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:52 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:35:54.087013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:54.087542 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:54.093322 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:54.093767 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:54.094628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:54.095066 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:54.214017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:54.221608 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4d80137b-4dbd-4a6b-9ea2-4f1a2cc039cb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.138311 Jul 28 09:35:54.222166 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 530/1118] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:54 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:55.238402 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:55.239026 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:55.245149 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:55.245593 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:55.246360 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:55.246814 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:55.366540 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:55.374882 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-42799846-a868-4a1f-bae0-df7fccf2ccd6 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.139861 Jul 28 09:35:55.375555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 589/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:55 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:56.394525 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:56.395138 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:56.401276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:56.401718 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:56.402479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:56.402910 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:56.525827 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:56.533929 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-2dd3c7c1-a291-476e-bf74-6fac8ec60ab2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.142918 Jul 28 09:35:56.534527 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 531/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:56 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:57.551178 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:57.551757 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:57.557640 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:57.558086 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:57.558849 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:57.559285 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:57.679938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:57.687393 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-59b21e2a-9ac8-4dff-98c9-86a00b1df261 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.139991 Jul 28 09:35:57.687975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 590/1121] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:57 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:58.703939 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:58.704584 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:58.710539 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:58.710993 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:58.711771 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:58.712198 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:58.830401 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:58.837794 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-c87a75a5-62cd-4dd0-a683-002eccfaf2d4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.137734 Jul 28 09:35:58.838345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 532/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:58 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:35:59.855145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:35:59.855824 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:35:59.862298 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:59.862745 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:59.863517 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:35:59.863979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:35:59.991485 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:35:59.998800 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-49d5c041-b3b4-4367-911d-7297f6a255cf tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.147228 Jul 28 09:35:59.999362 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 591/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:35:59 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:36:01.015997 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:36:01.016554 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:36:01.022351 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:01.022792 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:01.023545 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:01.024265 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:01.148533 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:36:01.156458 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-66e38500-ed0b-4de4-9a67-66f6092bff26 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.145010 Jul 28 09:36:01.157018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 533/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:36:01 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:36:02.173295 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:36:02.173905 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:36:02.179719 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:02.180162 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:02.180915 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:02.181339 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:02.303938 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:36:02.311895 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab14b40a-299f-4efc-a2a6-975feaf85ad4 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.142039 Jul 28 09:36:02.312453 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 592/1125] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:36:02 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:36:02.406892 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-6a71ca77-e0bf-435b-a57d-0b97b4f10320 req-f9acfec1-821d-4aa2-866e-f50beb1e3e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe9c147-922e-4b88-81b7-5e5fc25c4b33", "name": "network-vif-plugged", "status": "completed", "tag": "9c2786c4-77fe-4cf5-9aba-f61c414df2fd"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:36:02.408488 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:36:02.408488 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:36:02.416014 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-6a71ca77-e0bf-435b-a57d-0b97b4f10320 req-f9acfec1-821d-4aa2-866e-f50beb1e3e35 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:02.416463 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-6a71ca77-e0bf-435b-a57d-0b97b4f10320 req-f9acfec1-821d-4aa2-866e-f50beb1e3e35 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:02.427550 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-6a71ca77-e0bf-435b-a57d-0b97b4f10320 req-f9acfec1-821d-4aa2-866e-f50beb1e3e35 service nova] Creating event network-vif-plugged:9c2786c4-77fe-4cf5-9aba-f61c414df2fd for instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 on hv-cinder-80266 Jul 28 09:36:02.432617 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-6a71ca77-e0bf-435b-a57d-0b97b4f10320 req-f9acfec1-821d-4aa2-866e-f50beb1e3e35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083336 Jul 28 09:36:02.433207 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 534/1126] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:36:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:36:03.328152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:36:03.328767 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:36:03.335714 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:03.336159 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:03.336929 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:03.337359 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:03.462392 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:36:03.469524 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-0351bd81-5baa-4960-9add-f0736ef3a9fb tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1266 microversion: 2.1 time: 0.145218 Jul 28 09:36:03.470082 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 593/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:36:03 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:36:04.485974 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:36:04.486669 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:36:04.493139 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:04.493581 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:04.494340 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:04.494773 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:04.617479 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:36:04.625371 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-86ab192e-5436-42ae-9926-44f319ca0c29 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1454 microversion: 2.1 time: 0.143524 Jul 28 09:36:04.625976 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 535/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:36:04 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:36:04.641305 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:36:04.641925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:36:04.647675 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:04.648126 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:04.649154 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:04.649585 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:04.771442 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:36:04.779701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-5f516128-d43a-41af-86bc-6f1fdc5b261b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1454 microversion: 2.1 time: 0.141906 Jul 28 09:36:04.780264 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 594/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:36:04 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:36:06.629504 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-77abdfbc-81fc-4bbc-a99d-baf1582d779a req-415566e1-8675-4c69-8deb-6a689a9d4fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe9c147-922e-4b88-81b7-5e5fc25c4b33", "tag": "9c2786c4-77fe-4cf5-9aba-f61c414df2fd"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:36:06.631022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:36:06.631022 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:36:06.638057 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-77abdfbc-81fc-4bbc-a99d-baf1582d779a req-415566e1-8675-4c69-8deb-6a689a9d4fe7 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:36:06.639090 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-77abdfbc-81fc-4bbc-a99d-baf1582d779a req-415566e1-8675-4c69-8deb-6a689a9d4fe7 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:36:06.650558 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-77abdfbc-81fc-4bbc-a99d-baf1582d779a req-415566e1-8675-4c69-8deb-6a689a9d4fe7 service nova] Creating event network-changed:9c2786c4-77fe-4cf5-9aba-f61c414df2fd for instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 on hv-cinder-80266 Jul 28 09:36:06.655868 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-77abdfbc-81fc-4bbc-a99d-baf1582d779a req-415566e1-8675-4c69-8deb-6a689a9d4fe7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029956 Jul 28 09:36:06.656570 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 536/1130] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:36:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:36:17.636347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:36:17.637022 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:36:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:36:25.634338 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:36:25.634883 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:36:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:37:40.603081 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-650634560", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1180029500", "security_groups": [{"name": "tempest-secgroup-smoke-1050948725"}], "block_device_mapping_v2": [{"uuid": "129208ed-a7a2-4b26-a8e2-315988050048", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1fc2852d-286a-4480-bedd-ff38c463ba78"}]}} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:37:40.704722 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.network.neutron [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] validate_networks() for [('1fc2852d-286a-4480-bedd-ff38c463ba78', None, None, None)] {{(pid=107293) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 09:37:41.124891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Flavor limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 09:37:41.125342 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Image limits 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 09:37:41.125810 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Flavor pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 09:37:41.126222 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Image pref 0:0:0 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 09:37:41.126611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.virt.hardware [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107293) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 09:37:41.135887 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:41.136324 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:41.137111 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:41.137531 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:41.153991 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 09:37:41.158152 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.quota [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Getting quotas for user be335187506143e6a93fed6aa00005e0 and project 05659f9cc8374aa8b620b7f85c3b9efd. Resources: {'ram', 'instances', 'cores'} {{(pid=107293) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 09:37:41.218906 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Going to run 1 instances... {{(pid=107293) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 09:37:41.221049 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='129208ed-a7a2-4b26-a8e2-315988050048',volume_size=None,volume_type=None)] {{(pid=107293) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 09:37:41.341724 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-15dea607-73f4-4625-87cf-9fb00e0b621e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.743297 Jul 28 09:37:41.342367 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 595/1131] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Jul 28 09:37:40 2021] POST /compute/v2.1/servers => generated 406 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 09:37:41.354189 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-fe78c7f7-9008-464c-8476-65557da3b255 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:41.354889 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-fe78c7f7-9008-464c-8476-65557da3b255 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:41.406980 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-fe78c7f7-9008-464c-8476-65557da3b255 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:41.413853 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-fe78c7f7-9008-464c-8476-65557da3b255 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1094 microversion: 2.1 time: 0.065089 Jul 28 09:37:41.414414 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 537/1132] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:41 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:42.430069 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-ab1bc139-14aa-4a3c-a4b4-ff90d48cecaa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:42.430680 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-ab1bc139-14aa-4a3c-a4b4-ff90d48cecaa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:42.481440 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-ab1bc139-14aa-4a3c-a4b4-ff90d48cecaa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:42.488760 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-ab1bc139-14aa-4a3c-a4b4-ff90d48cecaa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1094 microversion: 2.1 time: 0.062393 Jul 28 09:37:42.489299 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 596/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:42 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:43.505097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9c10efe4-92c1-4437-a7e2-f7361d39ad0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:43.505793 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9c10efe4-92c1-4437-a7e2-f7361d39ad0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:43.569268 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9c10efe4-92c1-4437-a7e2-f7361d39ad0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:43.575751 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9c10efe4-92c1-4437-a7e2-f7361d39ad0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1094 microversion: 2.1 time: 0.074479 Jul 28 09:37:43.576311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 538/1134] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:43 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:44.592035 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bd59e046-fcc3-46de-b737-9ca66e8bf3a3 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:44.592678 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bd59e046-fcc3-46de-b737-9ca66e8bf3a3 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:44.645000 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bd59e046-fcc3-46de-b737-9ca66e8bf3a3 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:44.652206 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bd59e046-fcc3-46de-b737-9ca66e8bf3a3 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1094 microversion: 2.1 time: 0.063773 Jul 28 09:37:44.652986 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 597/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:44 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:45.668191 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:45.668802 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:45.675064 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:45.675534 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:45.676311 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:45.676738 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:45.735012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:45.743601 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-662fb949-e1e5-41e0-8a7e-49266825aa0f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1144 microversion: 2.1 time: 0.078984 Jul 28 09:37:45.744186 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 539/1136] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:45 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:46.760018 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:46.760659 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:46.779047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:46.779503 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:46.780323 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:46.780777 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:46.851762 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:46.859866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-79749322-eb1a-4274-83c1-1c90147f974f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1210 microversion: 2.1 time: 0.103504 Jul 28 09:37:46.860443 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 598/1137] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:46 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:47.591161 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [req-504c6f8a-c208-49c1-a979-fe40c81a01bc req-8e70a5df-6481-4649-bb52-3b6f2129c6dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a259c9-f284-423c-8a58-72b5423766c3", "tag": "d2e9a777-0d82-43f0-b5ef-2836550debb7"}]} {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:37:47.592795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:37:47.592795 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: warnings.warn(msg) Jul 28 09:37:47.609121 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-504c6f8a-c208-49c1-a979-fe40c81a01bc req-8e70a5df-6481-4649-bb52-3b6f2129c6dc service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:47.609564 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [req-504c6f8a-c208-49c1-a979-fe40c81a01bc req-8e70a5df-6481-4649-bb52-3b6f2129c6dc service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:47.622346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.compute.server_external_events [req-504c6f8a-c208-49c1-a979-fe40c81a01bc req-8e70a5df-6481-4649-bb52-3b6f2129c6dc service nova] Creating event network-changed:d2e9a777-0d82-43f0-b5ef-2836550debb7 for instance 05a259c9-f284-423c-8a58-72b5423766c3 on hv-cinder-80266 Jul 28 09:37:47.629270 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [req-504c6f8a-c208-49c1-a979-fe40c81a01bc req-8e70a5df-6481-4649-bb52-3b6f2129c6dc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041652 Jul 28 09:37:47.630054 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 540/1138] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:37:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:37:47.876638 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:47.877232 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:47.883100 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:47.883541 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:47.884347 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:47.884783 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:48.077249 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:48.084791 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4fdd32ab-0c76-44f0-b5f9-2657b4405d14 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.211849 Jul 28 09:37:48.085348 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 599/1139] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:47 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:49.102519 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:49.103126 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:49.109251 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:49.109694 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:49.110453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:49.110884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:49.235607 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:49.243225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-767f9bbe-592e-4404-9f5a-8ac0ab150768 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.144778 Jul 28 09:37:49.243823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 541/1140] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:49 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:50.259777 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:50.260399 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:50.266301 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:50.266740 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:50.267526 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:50.267982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:50.386668 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:50.394352 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-19d32d81-3d90-4149-b4a6-e3b394affd59 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.138329 Jul 28 09:37:50.394910 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 600/1141] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:50 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:51.411481 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:51.412128 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:51.417971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:51.418422 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:51.419188 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:51.419653 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:51.538987 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:51.546178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-a860f669-d527-4500-b58b-b1fee5bccde5 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.138995 Jul 28 09:37:51.546741 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 542/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:51 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:51.660971 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:37:51.661167 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:37:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:37:52.562008 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:52.562562 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:52.568597 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:52.569046 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:52.569806 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:52.570243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:52.698519 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:52.706219 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-bc065a8a-c6ed-48de-b7c1-3179f40065fa tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.147731 Jul 28 09:37:52.707197 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 601/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:52 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:53.725623 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:53.726225 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:53.732142 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:53.732593 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:53.733363 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:53.733797 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:53.852296 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:53.859440 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-7088b9cc-3460-46a3-a88d-096f43b8d27f tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.137516 Jul 28 09:37:53.860028 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 543/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:53 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:54.876701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:54.877313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:54.883391 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:54.883869 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:54.884634 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:54.885066 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:55.002313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:55.009591 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-50e2b9aa-42f7-46ab-b348-df3f2fa7e196 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.136563 Jul 28 09:37:55.010156 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 602/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:54 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:56.026830 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:56.027476 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:56.033356 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:56.034304 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:56.035069 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:56.035499 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:56.155894 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:56.164425 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-4dd215ce-5bee-4679-b640-30642c10ba12 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.141852 Jul 28 09:37:56.164988 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 544/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:56 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:57.182682 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:57.183304 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:57.189612 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:57.190092 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:57.190974 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:57.191410 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:57.335722 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:57.342982 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-c3e8da54-c150-4e25-9f95-79a3e3fc076e tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.164016 Jul 28 09:37:57.343550 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 603/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:57 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:58.359846 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:58.360471 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:58.369276 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:58.369735 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:58.370499 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:58.370933 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:58.491472 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:58.498750 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bd1a5a59-76e4-40fd-b75a-b9255a938207 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.142529 Jul 28 09:37:58.499245 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 545/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:58 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:37:58.888186 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a259c9-f284-423c-8a58-72b5423766c3", "name": "network-vif-plugged", "status": "completed", "tag": "d2e9a777-0d82-43f0-b5ef-2836550debb7"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:37:58.889774 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:37:58.889774 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:37:58.897589 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:58.898257 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:58.910086 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] Creating event network-vif-plugged:d2e9a777-0d82-43f0-b5ef-2836550debb7 for instance 05a259c9-f284-423c-8a58-72b5423766c3 on hv-cinder-80266 Jul 28 09:37:58.913477 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: ERROR oslo.messaging._drivers.impl_rabbit [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] [ef1d9d4a-142f-4ab7-92ab-13ec4b9b90b0] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 09:37:59.515439 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:37:59.516018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:37:59.522197 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:59.522648 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:59.523417 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:37:59.523884 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:37:59.641278 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:37:59.648747 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6828c8b0-909c-4553-8d30-98ec29930da2 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.137044 Jul 28 09:37:59.649308 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 546/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:37:59 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:37:59.930947 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] [ef1d9d4a-142f-4ab7-92ab-13ec4b9b90b0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43658. Jul 28 09:37:59.934160 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-53d5b177-68c6-49cb-8bea-b0253d778c98 req-3f256139-0b51-4ec6-89d7-0fcebe1d9559 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049795 Jul 28 09:37:59.934766 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 604/1150] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:37:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:38:00.664931 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:38:00.665540 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:38:00.671345 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:00.671828 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:00.672588 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:00.673018 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:00.801977 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:38:00.809204 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-ef266d07-aa53-45ab-844e-536e7206e751 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1266 microversion: 2.1 time: 0.147943 Jul 28 09:38:00.809758 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 547/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:38:00 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:38:01.827094 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:38:01.827838 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:38:01.834505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:01.834946 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:01.835729 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:01.836157 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:02.237736 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:38:02.245555 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-7abc2646-c228-45f7-9fba-842cdc051017 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1454 microversion: 2.1 time: 0.422409 Jul 28 09:38:02.246124 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 605/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:38:01 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1454 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:38:02.261650 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:38:02.262269 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:38:02.268689 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:02.269137 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:02.269898 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:02.270333 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:02.387628 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:38:02.395407 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-6502b094-77cb-4596-b284-413e2dde819b tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1454 microversion: 2.1 time: 0.137378 Jul 28 09:38:02.395994 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 548/1153] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:38:02 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:38:03.485168 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:38:03.485703 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:38:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:38:03.984037 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-a6154a64-c59b-458e-829f-2ae5dc87ff29 req-0708800f-2f9b-4845-85b5-51557c379bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a259c9-f284-423c-8a58-72b5423766c3", "tag": "d2e9a777-0d82-43f0-b5ef-2836550debb7"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:38:03.985019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:38:03.985019 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:38:03.992356 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-a6154a64-c59b-458e-829f-2ae5dc87ff29 req-0708800f-2f9b-4845-85b5-51557c379bb6 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:38:03.992788 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-a6154a64-c59b-458e-829f-2ae5dc87ff29 req-0708800f-2f9b-4845-85b5-51557c379bb6 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:38:04.003927 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-a6154a64-c59b-458e-829f-2ae5dc87ff29 req-0708800f-2f9b-4845-85b5-51557c379bb6 service nova] Creating event network-changed:d2e9a777-0d82-43f0-b5ef-2836550debb7 for instance 05a259c9-f284-423c-8a58-72b5423766c3 on hv-cinder-80266 Jul 28 09:38:04.008998 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-a6154a64-c59b-458e-829f-2ae5dc87ff29 req-0708800f-2f9b-4845-85b5-51557c379bb6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029009 Jul 28 09:38:04.009641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 606/1154] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:39:30.379866 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90e9f45c-2cde-49e9-a278-1ed805d55ba3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 09:39:30.386661 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:30.387169 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:30.389248 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-de4af68a-1790-4c58-9f28-350e59fb67f9 req-b5019386-cd32-4db1-8356-8800a0f23d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a259c9-f284-423c-8a58-72b5423766c3", "tag": "d2e9a777-0d82-43f0-b5ef-2836550debb7"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:39:30.390781 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:39:30.390781 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:39:30.393489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:30.394027 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:30.395012 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:30.395509 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:30.397701 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-de4af68a-1790-4c58-9f28-350e59fb67f9 req-b5019386-cd32-4db1-8356-8800a0f23d1b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:30.398145 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-de4af68a-1790-4c58-9f28-350e59fb67f9 req-b5019386-cd32-4db1-8356-8800a0f23d1b service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:30.409558 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-de4af68a-1790-4c58-9f28-350e59fb67f9 req-b5019386-cd32-4db1-8356-8800a0f23d1b service nova] Creating event network-changed:d2e9a777-0d82-43f0-b5ef-2836550debb7 for instance 05a259c9-f284-423c-8a58-72b5423766c3 on hv-cinder-80266 Jul 28 09:39:30.415243 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-de4af68a-1790-4c58-9f28-350e59fb67f9 req-b5019386-cd32-4db1-8356-8800a0f23d1b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036331 Jul 28 09:39:30.416206 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 607/1155] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:39:30.424433 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:39:30.501314 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-df965991-3c28-4ea1-82b2-0ff8cff30562 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "DELETE /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 204 len: 0 microversion: 2.1 time: 0.125932 Jul 28 09:39:30.505217 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 549/1156] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:39:30 2021] DELETE /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:39:30.511382 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:30.512574 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:30.519377 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:30.520098 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:30.521194 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:30.521968 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:30.739774 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:39:30.749611 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-f0c0e6be-dd0f-4317-8ac9-87694963fc45 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1579 microversion: 2.1 time: 0.242694 Jul 28 09:39:30.756682 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 608/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:30 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1579 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:39:31.822168 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:31.823005 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:31.828727 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:31.829178 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:31.829956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:31.830394 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:31.951097 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:39:31.958396 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-0a7ce5f3-8d0d-4c41-bc26-3a1f0472842c tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1460 microversion: 2.1 time: 0.142114 Jul 28 09:39:31.958956 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 550/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:31 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1460 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:39:32.761829 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-727511ee-0cfc-4416-b3f1-1098333a235b req-1d3b00f0-4c15-41ce-9b32-5404753dc659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a259c9-f284-423c-8a58-72b5423766c3", "name": "network-vif-deleted", "tag": "d2e9a777-0d82-43f0-b5ef-2836550debb7"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:39:32.763475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:39:32.763475 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:39:32.784251 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-727511ee-0cfc-4416-b3f1-1098333a235b req-1d3b00f0-4c15-41ce-9b32-5404753dc659 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:32.784755 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-727511ee-0cfc-4416-b3f1-1098333a235b req-1d3b00f0-4c15-41ce-9b32-5404753dc659 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:32.792487 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] [90e9f45c-2cde-49e9-a278-1ed805d55ba3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43712. Jul 28 09:39:32.801055 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-727511ee-0cfc-4416-b3f1-1098333a235b req-1d3b00f0-4c15-41ce-9b32-5404753dc659 service nova] Creating event network-vif-deleted:d2e9a777-0d82-43f0-b5ef-2836550debb7 for instance 05a259c9-f284-423c-8a58-72b5423766c3 on hv-cinder-80266 Jul 28 09:39:32.806990 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-727511ee-0cfc-4416-b3f1-1098333a235b req-1d3b00f0-4c15-41ce-9b32-5404753dc659 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049485 Jul 28 09:39:32.807641 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 609/1159] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:39:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 09:39:32.975229 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:32.975803 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:32.982141 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:32.982585 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:32.983415 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:32.983959 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:33.048948 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:39:33.057453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-058555d7-a3b7-4e6d-9da4-e97293fc1687 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 200 len: 1225 microversion: 2.1 time: 0.086058 Jul 28 09:39:33.067368 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 551/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:32 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:39:34.075610 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:34.076226 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: 05a259c9-f284-423c-8a58-72b5423766c3] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:34.082240 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:34.082683 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:34.083467 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:34.083925 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:34.097251 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] HTTP exception thrown: Instance 05a259c9-f284-423c-8a58-72b5423766c3 could not be found. Jul 28 09:39:34.097821 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Returning 404 to user: Instance 05a259c9-f284-423c-8a58-72b5423766c3 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:39:34.098619 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-4970232d-57ce-465b-b571-797971150307 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3" status: 404 len: 111 microversion: 2.1 time: 0.027632 Jul 28 09:39:34.099118 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 610/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:34 2021] GET /compute/v2.1/servers/05a259c9-f284-423c-8a58-72b5423766c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:39:37.353772 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:37.354823 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:37.360524 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:37.360989 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:37.361769 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:37.362209 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:37.386810 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Going to try to terminate instance {{(pid=107292) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 09:39:37.443530 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-358d0b42-50ef-4708-ac14-08373e6b3aeb req-1b5bfb4a-0d0e-4cd4-a3a8-d7d104a9cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe9c147-922e-4b88-81b7-5e5fc25c4b33", "tag": "9c2786c4-77fe-4cf5-9aba-f61c414df2fd"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:39:37.444992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:39:37.444992 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:39:37.452746 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-358d0b42-50ef-4708-ac14-08373e6b3aeb req-1b5bfb4a-0d0e-4cd4-a3a8-d7d104a9cf3a service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:37.453185 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-358d0b42-50ef-4708-ac14-08373e6b3aeb req-1b5bfb4a-0d0e-4cd4-a3a8-d7d104a9cf3a service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:37.465169 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-358d0b42-50ef-4708-ac14-08373e6b3aeb req-1b5bfb4a-0d0e-4cd4-a3a8-d7d104a9cf3a service nova] Creating event network-changed:9c2786c4-77fe-4cf5-9aba-f61c414df2fd for instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 on hv-cinder-80266 Jul 28 09:39:37.470636 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-358d0b42-50ef-4708-ac14-08373e6b3aeb req-1b5bfb4a-0d0e-4cd4-a3a8-d7d104a9cf3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122768 Jul 28 09:39:37.470920 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-bff318f0-209b-4957-b05d-9f96871b0bb0 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 204 len: 0 microversion: 2.1 time: 0.124587 Jul 28 09:39:37.471700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 611/1163] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:39:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:39:37.471854 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 552/1163] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:39:37 2021] DELETE /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 09:39:37.481313 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:37.482013 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:37.488235 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:37.488700 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:37.489471 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:37.489907 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:37.688289 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.policy [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107293) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:39:37.697654 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-55e8e3ad-72ff-4756-b52a-2f0808b0b1a1 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1579 microversion: 2.1 time: 0.220637 Jul 28 09:39:37.698544 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 612/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:37 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1579 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 09:39:38.715694 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:38.716391 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:38.722154 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:38.722604 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:38.723360 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:38.723824 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:38.844013 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:39:38.851238 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9c5e842d-283d-446f-8c4a-aa465ff6d04d tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1460 microversion: 2.1 time: 0.140213 Jul 28 09:39:38.851834 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 553/1165] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:38 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1460 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:39:39.405383 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [req-4b746386-3e92-4002-94d4-9090808bfca1 req-827368ba-eede-469b-8828-9def77ab1469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe9c147-922e-4b88-81b7-5e5fc25c4b33", "name": "network-vif-deleted", "tag": "9c2786c4-77fe-4cf5-9aba-f61c414df2fd"}]} {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 09:39:39.407337 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 09:39:39.407337 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: warnings.warn(msg) Jul 28 09:39:39.414240 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-4b746386-3e92-4002-94d4-9090808bfca1 req-827368ba-eede-469b-8828-9def77ab1469 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:39.415505 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [req-4b746386-3e92-4002-94d4-9090808bfca1 req-827368ba-eede-469b-8828-9def77ab1469 service nova] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:39.426579 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.compute.server_external_events [req-4b746386-3e92-4002-94d4-9090808bfca1 req-827368ba-eede-469b-8828-9def77ab1469 service nova] Creating event network-vif-deleted:9c2786c4-77fe-4cf5-9aba-f61c414df2fd for instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 on hv-cinder-80266 Jul 28 09:39:39.431676 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [req-4b746386-3e92-4002-94d4-9090808bfca1 req-827368ba-eede-469b-8828-9def77ab1469 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030413 Jul 28 09:39:39.432254 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 613/1166] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Jul 28 09:39:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 09:39:39.868575 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:39.869199 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:39.874949 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:39.875397 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:39.876200 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:39.876630 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:39.909807 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:39.910252 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:39.910696 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.objects.instance [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lazy-loading 'fault' on Instance uuid fbe9c147-922e-4b88-81b7-5e5fc25c4b33 {{(pid=107292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 09:39:39.952671 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.policy [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be335187506143e6a93fed6aa00005e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05659f9cc8374aa8b620b7f85c3b9efd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107292) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 09:39:39.959935 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-73b6f355-e681-44a0-aca0-d7770a3b4dd9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 200 len: 1230 microversion: 2.1 time: 0.095384 Jul 28 09:39:39.960498 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 554/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:39 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 09:39:40.978345 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:40.979047 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: fbe9c147-922e-4b88-81b7-5e5fc25c4b33] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:40.985091 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:40.985528 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:40.986281 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:40.986733 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:41.000101 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] HTTP exception thrown: Instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 could not be found. Jul 28 09:39:41.000686 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Returning 404 to user: Instance fbe9c147-922e-4b88-81b7-5e5fc25c4b33 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:39:41.001484 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-133571a9-0895-45d6-aa14-3946ec569a0a tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33" status: 404 len: 111 microversion: 2.1 time: 0.027316 Jul 28 09:39:41.001993 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 614/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:40 2021] GET /compute/v2.1/servers/fbe9c147-922e-4b88-81b7-5e5fc25c4b33 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:39:41.446902 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:41.447489 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.compute.api [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107292) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:41.453164 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:41.453616 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:41.454453 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:41.455047 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG oslo_concurrency.lockutils [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:41.471017 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.wsgi [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] HTTP exception thrown: Instance f9497a09-01fe-443f-9026-79e18807af68 could not be found. Jul 28 09:39:41.471630 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Returning 404 to user: Instance f9497a09-01fe-443f-9026-79e18807af68 could not be found. {{(pid=107292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:39:41.472462 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-9b48a73a-3b02-437f-ab23-fb48a6d37796 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 404 len: 111 microversion: 2.1 time: 0.029864 Jul 28 09:39:41.473011 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 555/1169] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Jul 28 09:39:41 2021] DELETE /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:39:41.481403 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '>' {{(pid=107293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:41.482018 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.compute.api [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [instance: f9497a09-01fe-443f-9026-79e18807af68] Fetching instance by UUID {{(pid=107293) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 09:39:41.487891 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:41.488340 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:41.489097 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 09:39:41.489529 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG oslo_concurrency.lockutils [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Lock "77f53108-6070-4f98-9489-b65bf1d32c10" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 09:39:41.503369 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.wsgi [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] HTTP exception thrown: Instance f9497a09-01fe-443f-9026-79e18807af68 could not be found. Jul 28 09:39:41.503977 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: DEBUG nova.api.openstack.wsgi [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Returning 404 to user: Instance f9497a09-01fe-443f-9026-79e18807af68 could not be found. {{(pid=107293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 09:39:41.504781 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO nova.api.openstack.requestlog [None req-eb4a525c-56d2-4801-8020-3e7c0189f5e9 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68" status: 404 len: 111 microversion: 2.1 time: 0.027033 Jul 28 09:39:41.505290 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: [pid: 107293|app: 0|req: 615/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Jul 28 09:39:41 2021] GET /compute/v2.1/servers/f9497a09-01fe-443f-9026-79e18807af68 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 09:39:42.784346 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d6a213-4f50-4b3a-9710-c704a296fd53] AMQP server on 10.222.0.23:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 28 09:39:42.787638 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: DEBUG nova.api.openstack.wsgi [None req-54b695fe-186d-4554-b7d4-c07190976fe7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] Calling method '.version_select at 0x7f16d04573a0>' {{(pid=107292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 09:39:42.790963 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54b695fe-186d-4554-b7d4-c07190976fe7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [de57f646-8d71-46ec-a07e-14e6f1cc874e] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 09:39:43.810920 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d6a213-4f50-4b3a-9710-c704a296fd53] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43770. Jul 28 09:39:43.811935 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [None req-54b695fe-186d-4554-b7d4-c07190976fe7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] [de57f646-8d71-46ec-a07e-14e6f1cc874e] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43772. Jul 28 09:39:43.831177 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO nova.api.openstack.requestlog [None req-54b695fe-186d-4554-b7d4-c07190976fe7 tempest-TestVolumeBootPattern-1081368840 tempest-TestVolumeBootPattern-1081368840-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1180029500" status: 202 len: 0 microversion: 2.1 time: 1.047952 Jul 28 09:39:43.831776 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: [pid: 107292|app: 0|req: 556/1171] 10.222.0.23 () {58 vars in 1263 bytes} [Wed Jul 28 09:39:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1180029500 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 09:41:11.678645 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:41:11.679422 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:41:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:41:23.503316 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:41:23.503975 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:41:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:42:57.659448 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:42:57.660211 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:42:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:44:31.697061 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:44:31.697547 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:44:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:44:43.524979 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:44:43.525511 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:44:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:44:45.658092 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:44:45.658796 dv-cinder-802669-1-iscsi devstack@n-api.service[107292]: Wed Jul 28 09:44:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 09:44:54.375521 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 09:44:54.376108 dv-cinder-802669-1-iscsi devstack@n-api.service[107293]: Wed Jul 28 09:44:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!